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ABSTRACT 

The Secondary Form of the Educational Quality 
Assessment (EQA) Inventory is designed for 11th grade students in , 
^Compppwealth public schools. Test scales *are designed to Ojeasure some 
face-t of gtate quality a'ssessjaent goals. Along with basic^ skills^ the 
various instruments examine :^/(1) social and health habits, (2) 
.feelings toward self .and others, (3) value placed on learning'- and 
human accomplishaentr V^) interest in creative activities, (5) 
met^ho<3yB of coping with- f r«ustr^^ion , and (6) attit^ides toward work" and 
career plaiining. Extensive ipve^stigation <:onc,erning the consistency 
of sftudent rpsgohses within each, s.c^^ .and the stability of student 
responses to' the' scales over time Jiis .been conducted. / Total scales", 
yielded high internal consistency teliaiility^ while shorter subsc^ij^sl 
were, weak. Strong correspondence between ratings made by teachers -auid 
student scores was, demonstrated for seven of the att/itude scales,! Tjie 
u^nit of analysis of .all data receyived* froji* the EQA was^feh^ school^-' ^ 

:udCTt-/Doay standing 



The inventory p^^ided ii^f ormati^dn on: (1) st\ 
each composite goal test reiatiy^ to- a statewide 
student-body standing relative t^ groups similar 
enirironments, and (3) proportion of student-body 
minimum positive attitude^. (Author/BJG) ' 



rc^ference grou^^::^[<2) , 
in home and Schqt^l^^'/ 
w/ho demonstrated5;/*'r. 
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GETTING ACQUADmD 

; The Secondary Fofm of Education^ jQaality Ass^mcnt Inventory (EQAI) for 
grade 11 is. an assessment device designed to give C(>nim9n wealth edutators meaningful, reliable, 
and accurate information about their students' develo^ent in each of the Ip^state adopted quality 
education goals. The EQAI can be characterize as a collection of highly structured, 
paper-arid-pencil measuuement scales. These scales represent an attempt to appraise various aspects 
of cognitive and hunian interaction skills together with those attitudes, values, and beliefs thought 
important in helping our young people adjust to the demands of today's society and tomprrow's 
worid. , j ' ' * 

Is this a complex task? Yes. Can it be done in such $ way as to provide reasonably 
accurate information? We believe so. However, big words /and fancy phrases don't get the job 
done, ' ' ' ^ ^ . 

To insure that the scales included in the EQAJ' could provide' relevant information, 
the Department of Education maintained the stance of Jtesting the tests b^|ore using them to 
test people. After completing the tasks of operation^y defining each goal ^a and developing 
measurement, rationales consistent with these Befmitions, the department went to the field. ' 

Over 175 Pennsylvania school cBstricts gave the Department of Education needed 
logistical , support, while over 20,000 students gave their time in an effoi^to field-test the scales. 
.During the five-year pilot phase of the Educational Quality Assessment project (1^69«1974), 
approximately '45 separate instruments containing ovei; 2,000 items were evaluated as to their 
ability to provide accurate and reliable information pertaining to student progress in the 10 quality 
education goal areas. ^ 



This booklet describes in detail those scales that survived the logical and statistical checks 
and remain in the final form of the EQAI. Aspects of the descriptions are necessarily statistical 
an'd are cduched in the language of the test and measurement field. Because the information 
contained in the publication is equally relevant to school personnel and research scientists, we 
have made a concerted effort to include explanations of the logic behind the various analytic^ 
methods used to determine the adequacy and ,the efficiency of the tests- * 



. QUESTIONS AND ANSWERS 

/ ABOUT EQA INVENTORY ^ * 

the Secondary Form of th EQA Inventory is 'designed ' for 11th grade ^students in 
Commonwealth public schools. The reading difficulty level of the various instruments contained 
in, the test package range front grade 5 through grade. 8. ^ ^ ^ 

How long is the inventory? " ' • 

Twelve tests containing a total of 475 items make up the student assessment ^portion 
of the battery.' Six additional questions seek student background information ab9ut occupation 
of father or legal guardian, education of tnother, race, sex, size and type of cojnmunity, and 
stability of residence. Finally, 16 questions ask students about accessibility of library and school 
counseling experiences, ways in which they receive recognition from peers, parental attitude toward 
the school and hbme climate. ^ • ; . ' 

What kinds of tests pre in the inventory? 

% Three multiple-choice instruments tap cognitive skill, achievement 'and awareness in the 

, areas of ' verbal analogies, mathematics- and vocations 'respectively. The rtath an4 verbal tests are 
timed. The remaining nine are self-report attitude and interest scales asking students to respond 
t'o statements on various continuums such as agree-disagr^e^ true of me-not true of me, yes-no, 
etc. ' ' • s * ' ' 

What do the tetsts cover? . *^ 

/: * Each scale is designed to measure so.m^ facet of on? state qu3j[ty education goal. Along 
'^^^ with basic skills the various instruments examine 1) social and health ^habits, 2) feelings toward 
self and others, 3) value placed on It ning' arid human accomplishmenfe^^interest in creative 
activities, 5)*methods of coping with : .tratiSn and 6) attitudes toward wOTR^d career plapning. 

Do the tests completely cover each *gbal? » ^ - . 

^ * No. The goals are very broad statements organizing m'any related concepts under one 
umbrella. An inventory of 5,000 items probably coul^ not measure tHe goals in^ their entirety. 
Strong efforts have been made to sample sorpe of tKe most salieiit facets of each goal Section 
One in this book describes irt ^detail which aspects of the goals are measured. . 

What types of scoring procedures are used?. / 

For the achievement tests simply the number of correct answers is^ counted. The attitude 
" scales are scored in two ways. First, each set^of response options is given a weighting consistent • 
with its corresponding item's 'direction (i.e. I like school; strongly agree = 3,;agree = 2, disagree 
' =1, and strongly disagree = 0). Item -scores are then summed to form a composite score. This 
is called norm-referenced scoring. The second procedure classifies- options into categories of 
favorable and nonfavorable. In the above example the strongly agree agree choices are given 
a score of one while disagree arfd strongly disagree are*^Ven a score of zero. Students choosing 
favorable responses on a simple majority of scale items meet the criterion pt minifhuni positive 
attitude. This techniqi^ is called criterion-referenced scoring. • 



Can the tests be used to pinpoint specific st\ident-body strengths and weaknesses? 

* - *■ 

Yes. With^the exception of tlje basic skills inst^ments, all questionnaires are brpken 
into smaller components called subscales. The inventory's 29 slibscales give more specific 
information than can be provided by the composite scores alone. For example, the Go#l 
V-^CHizenship instrument--offers additional scores rn the areas of 1) concern for the welfare and 
dignity of others, 2) respect for law and authority and 3) personal responsibility and integrity. 
Section One contains descriptions of. all subscales. . • ^ 

Are the tests reliable? 

Extensive investigation concerning the consistency of student responses within each scale 
(internal consistency) and the stabUity of student responses to the scales ov^ time (test-reteat 
reliajbility) have been conducted by Division of Education^Quality Assessment personnel. All 
total scales demonstrate high internal consistency reliabililfirand adequate stability. Some o| the 
shorter subscales^ however, demonstrate weak internal con^iWency reliability. Reliability statistics- 
for all subscales and total instruments are presented infsecjtion Two. 



Do students* fake their answers? 



response bi^sTburing field 
iftstrufnent called the social 
,e Qneself look good. Where 
lations between. //e and 



All self-report questionnaires are susceptible to this s»r 
trials correlations, V were compii|ed between test scores and^a speoi 
desirability^ scale which' is designed to pick up the tendency to 
large correlations were , found, the tests were revised or dropped.^^ 
total instrument scores are presented in Section Two. , * ' 

Are the tests valid? * * 

Strong correspondence between ratings made by teachei/ and 'the student scores has 
been demonstrated for seven of the attitude scales. [Results for 'a( gr^up of studies conducted 
by the Division of Research, coupled with outcomes/ from a factorVna^ysis lernijaurther validity 
support. Findings relating to test validity are preselftted in Section " 

How' much does testing climate affect final outcomes on the tests? 

. ^ A 1 971 study involving 91 ^hooFs showed that the emotional climate (student eagerness, 
•concentration and carefulness) hi^came poorer as the testing session progressed. CorreMions 
between emotional ^jlimate and inStrument scores, although slightly positive, were not* statistii^ally 
significant*. Also schools? experiencing adverse testing conditions in terms of settings^ disjractions, 
etc. were not found to sif^e^ lower than schools with no testing distractions on any of the scales. 

Are individual student profiles provided? ^ ' \ . ' * 

^o. The unit of analysis of all data received from the Educational Quality Assessment 
Pro-am is the school. No individual student profiles are given. In fact, student names are removed 
fr6m the answer, booklets before being scored as a means of insuring confidentiality of student 
answers. - • . . . 

Do the tests identify target groups for program focils? " 

' Yes. Even though individual records are unavailable, it is possible to organize data to 

help identify general student groups having difficulty in a goal area. This is done by summarizing 
data for various subgroups, of students formed frqpi .selected student characteristics. The three 
student characteristics in these analyses are ability levels sex and father's occupation. Section 
Foiywhfow's the prpportion of students in each of 18 subgroups Who* dempnstrate positive attitudes 
on /all goal instruments except basic skills -and vocational /awareness. 



Is the EQA Inventory the only source of info^mtion for the Educational Quality Assessment 
Program? ^ . ' * / 

^ • No. In addition lo the student qpestionnaires, there are surveys fo,r teachers and school 
administrators. The results of these surveys are combined to generate a report for eacl^ participating 
school. For a complete description of the contents of these surveys refer id Manual for Interpreting 
School Reports. / 

What kinds pf information does the inventory ' provide? 

Information includes' 1) student-body standing on each composite 'goal test relative "to 
a statewide reference group, 2) student-body standing relative to groups simUar in' home and , 
schpol environments, ^nd 3) proportion of student-body who demonstrate miriimum positive 
attitudes.^ ^ . y * . 

Are teachers held accountable for poor test scones? - \' 

No. The Educational Quality Assessment Program uses three" separate assessment 
inventories to examine student goal achievement, at grades 5, 8 and 11. Students at dther grade 
levels do not take the tests^ Test outcomes ar^ not solely a result of what teachers ' at those 
three levels are or are not doing. Student attitudes and achievements are a complex product 
of the total home, school ^^d community experience. Accountability only comes into play in": 
terms of taking quality assessment' results into consideration ^^hen trying to meet the needs of 
stucjlents. . ' - * < ^ " i 

Does the Departix^ent of. Education offer any help in identifying and implementing, curricular 
strategies < that might increase stifdent goal achievement? 

Curriculum specialists are investigating new curricular approaches and relatedditerature 
in the hope of offering interested Pennsylvania schools help to meet stu^fent goal needs^. As these 
materials become finalized they aje being made Available to school dwtrict^. 

Is there any indication that schools can improve student attitudes jby implementing programs? 

' ^ Yes. Several programs .developed by school districts haVe already yielded measurable 
I improvements on the €QA Inventory scales. The most recent example- involves a large district 
4n western Pennsylvania that under an ESE^ Title III grant implemented curricular changes which 

resulted in an increase in their student-body's interest in leamiqg. Specific informatibn about' 

this project is available at the offices/W the Division of Educational Quality Assessment upon 

request. * • 

What information is. contained in tlm booklet? ' ' ' ' . 

Section One discusses the 10 quality education--goals and the measurement devices 
associated with each. Included in this section are '.goal and measurement rationales^ ^?de and 
subscalje^ descriptions, and spedficatiohsi^for scoring. Section Two describes the safeguards used 
to proBuce tests of- high quality and describes how the.EQAI tests fare^on these dhi^ks. The 
third section surveys the results of^ validity studies including teacher ratings, factor analysis, and 
independently conducted studies. Section t^our identifies potential student target groups for 
program focus. ' < ' ^ - , ^ 




^Are there any additional statistical summaries on the tests which are not pdntained in this booklet? 

Yes. This booklet highlights only the m^or empirical data that are available on the 
EQA Inventory, Additional materials include item frequency ^'distributions, ppr cent favorable 
r^sF^onses to eagh item, atem-to-totaf -correlations, a complete factor anal/sis with orthogonal 
rotations ^through 10 factors and various other descriptive statistics including skewnefe, 
kurtosis, meansj^standarfl deviations and standard errors of measurement for each sub and total 
scale. '.These are in computer-printout form and may t>e seen at the offices of the Division of 
Educafioi^l Quality Assessment in Harrisburg, • ' ^ " 
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Look, AT Me / . I'm Putu.; 

GOT MOTHiM OH -megAU^ 
SOB. 




QOAL I Self-Esteem 

Quality education should help every child acquire the greatest possMj^ understajiding of himself 
or herself an^appreciation of his or her worthiness as a mejn^iff^^ society. 



GOAL RATIONALE 



It is wide^ held that self-understanding is signijjtfjantly^ ^gciated with personal- 
satisfaction and effective functioning. How students view then{^|^^equadfe^lmd inadequacies, their 
vaiups and desires, can stron^y' influence their perfohnanpe^^yih school. 

No matter what the level and pattern of stud 
strengthen, not damage, their srfP^steem. School si 
levels can appreciate their worth as persons in a sj 
for all its members/ 

' MEASUREMENT RATIONALE 




^_.nts, the schoo| experienjce: should 
pferate so that children of talent 
tV'^ qiat claims to be equally concerned 



f 7 



t _ 



* I Self-esteem is-a personal judgmept df worlh^n0s'§. ItMs^|^ubjective experience which 
the individual ponVeys to others verbally of by other .^havior^Most theories acknowledge that 

our self-image and feelings of worthiness are deterpiined largely by how " " 

to mi own aspirations and meet expectations of otfiers. * 



well we can live up 



Aspirations become closely associated >yitlji personal goal-setting b< havior originating in 
our internalized system of values. Expectations a^ external in Mature and are related to go^s 
'set collectively by society or by significant individuals in our lives. Assessment iiPljthis area is 
based on four compojients 4)elieved to be related, to the development of positive self-esteem, f 

The first has to do with locus of conm)l — whether, one views personal success as 
dependent^pon ohe*s own efforts or external ii|!fluences. ,E?ctemally controlled individuals will 
tend to be more dependent on others and more 'willing to ride with the tide, accepting docilely 
things which'^happen to ^em. Internal individuals will more actively attempt to control self-destiny. ' 

The second related concept is self-cpnfidence — the^feeling of self-worth and the belief 
that one is capable of handling things succJ^ssfuily. Those who lack self-confidence are often 
characterized as being timid, cautious, submi^ive individuals' who feel inadequate, fearful, inferior 
and expect to be unsuccessful in dealing |idth new situations. ^ 

The third* component is image ^'in school settings. Those having favorable self-images 
are likely to experience subjective success with school work, 'feel that they are favorably, viewed 
and understood by teadhers and enjoy J?:lass participation. 

■ i • ' " 



r 



The final dimension -considers how students feel«about the quahty of. tfieii relationsMps 
with others. Individuals who have difficulty in ihterpersonal relations will ten id to believe that 
others have, little confid^snce in *0r low regard Tor them. \ * . ! . .\ 

GENERAL SCALE DESCRIPTION* 

The ^If-esteem scale is compnsed of 40 short, self-despription statements. Twenty^onc 
are , positively Worded— describing the student in a favorable light and t9 are negatively worded 
—characterizing the^stildent in -a'->negativi^' vein. • ' -V-* " . - 

Samifle positively worded item: Tm easy to get along with. .-^^ ^ ;/ - 

Sampler negatively/ worded jtem; ^ings^ote^ all - mixed up in 'nt^, Ufi , : [■ ^ / 
Response options available to the ^tudemts are fl) verj^ true Qf^p%:(2)rniostIy true of me,, (3) 
mostly untrue of me and (4) 'veiy/lfritrue»of me/' ^ ^ "'^^ _ / - • . . 



Subscale 2u 



The items within ^the scale are/^ujped. to, j^ield Jgur. subscale scores in addition .to 
a total scale score. ^ ' ^ ' ' " ' ' ' ' . , ' 

■ ■ ' ' A' ' ' ■ ' ■• ^ . ' ' 

Subscale J: ^elf:cdnf^dence contains 10 items measuring -feelings gf success, self-determination, 
attractiveness and^self-worth.' Sample itenK I'm pretty sure of myself, ' • • 

Feelings of control oyer environment contains 10 items* tapping belief that success 
^n school and Work depend on effort, not luck.' Sample item: Myjgetting good 
. ^ades in schQol depends more on how the teacher feels about me itKan on how 

wfiU I can do my work . . 

. . , . ' - • \ ' • 

Subscale 3v Relationships y^ith others cpn tains 10 items assessing; the student*s perceived ea^ 
• , iji making and keeping friends -and the* student's feelings of acceptance by otl\ers.^ 
, • . S^ple iten^: / often feet picked'on by^ other kids, . 

.Subscale 4: • Self-image in school cbmprises^ 10 items designed to me^isure feelings of success 
^ • ' "in school- work, class recitation and ^acher relationships! Sample ilem:^/w class, 
1 oftenr4c^l 'put :down*by teacf(er^. • • , • ' . 

NORM-REFERENCED SCORING 

' ' " For norm-referenced scoring the item weighting scheme used is: - .- - 

^ . Response Choices 



Item 

EHrection 



• \ 

Very True. 
^ of Me 



Mostly Ttiie' 
f of Me 



Mostly Untrue 
of Me 



Very Untrue 
of Me . 



Positive 
Negative 



3 
0 




1 

2 



0 
3- 



♦The self-esteesm scale. is a result, of extensive I^Visibn of the Goal I instrument which was used- 
for ^ades 5 aijd 11, Richard L. Kohr and NoJ^an F. Russell from thft Division of Educational 
Qu ality. Assessment 'were responsible for the revisions. - - < . 



CRITERION-REFERENCED SCORING 



N Responses are cpnsidei^d /avorafi/e if 'they- reflect a positive sel^^^ 
score on a given scale (total or subscale) is the percentage. of items to which a favorable response 
was given, f^or the 'self-esteem instrument the scoring scheme applied to the items is: * 



Item 

Dinection • 



. Very True 
» of Me 



Resfioh^e Choices 



Mostly True\ 
of Me ^ 



Mostly Untrue 
of Me 



i 



Very Untrue 
of Me 



Positive 
♦ * • 

•Negative 



1 
0 



1 
0 



> 0 

1* 



.0 

1 



■ V 



* 
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GOAL II Tolerance ^Towani Ot^ 



Quality education should help every child/icquire uhdetitandnig .aj^^ 
belonging to oth^ social, cultural and ethnic gr6ups; ' * ' 



GOAL RATIONALE 



V 



J 



^ Students fulfilling the requirements, of Goal, H W^jncjie 1^ e^sy interaction * 
with fl// *peopie~$*peakirig to and. seie^tin^. as friends studfeni^^;^^^ and beliefs/" 

'They wHl be more wUliijg tp actively seek information which wiU 

increase/their ^knowledge abbut^different cultilues .and sodal/^ttm^/ ' . \ 

The school experiences ?hould |lelp^^mdenfe fca^ to^f^pett;fed;iiite^ 
children who differ froin -tfiem in' varioi^'26i>^c^ , \ 

status, religious beliefs, physical abiUties^^iniriQefpr^ degree of mteUe^ti^ai-CQr^^ 



MEASUREMENT RATldNAtE A .i. x 

TTierf processes andf deVejiginantt jof iftterp^ are\omplex, involving a ,.,.4^ 

niyrjad of 'perceipt;j^, feeliii^ . \ • ^ 



' xi^'^-; i^r'/Sonie 'dpfin^^|oIerahce in' ^mis jj>f lihei^ocidl!d{sta^ thejnselves and 



•-, 




Differences 

N 

suggest an a'p p|b|ch '.towaid' ^the student, e.g.,.;;^:<^pple wants \ \. 
• -^^^f fi'^Md- six. litems, su^'s^an avoidance of sibident, e^g., i4?|^/-( w/fA 

' C 'iXr^3'^-'^ becaiise she^^fiinks you imight make /«« ro/^Aer .Response' 4»6t6es are 

.?rVv^v3w?fl»iKelt<!l) yerrf comfortabl^^^V.cbmft^^^^ f3V aKiiiithr ^fcoittfortable and'V^ 




X 



. The items within the scaK^ire/grooped.ig/yigld five subscale scores in addition to a 
total scale score. Assignment to subsfcales is b^ed upon fhe characteristic of the hypothetical 
target person that makes that pereon diiF^erent ifbrri the respondent. The five subscales are race, 
religiqn, socioeconomic status, intelligfence siQ- hSridi(aii;'M subscales .contain seven, items. 

• NORM-RHfERENCED SCORIPlG - . / ' . - . \ ' ' r . , 



/ 



For nb,rm-j«ferenced scbring, the"^ item -wpighting^ scheme ^is 



Response Oj^tibns 



. Item 


Very" 


Direction 


Comfortable. 


Positive 


' ^ y ' 


Negative 





SUghtly^ 



Very 



/ 



, 2-' 



0 

3. 



CRITEIUONofe'ERENCED sd)RfNC 



Respb;ises are considered favorable if fhey reflect comfort whpri interacting witii aiffering 
others or discomfort W?i«5n. being shunned by differing others. An/individual's score on a given 
scale (total of suj)scale); is; the percentage of items to which a,f{rrorable response was given. For 
the. "tolerante^ toward others instrumenF the scoring* schemribr items, is: 



\ 



Jte^mf;' ^ 



.'(Comfortable 



Response 0{)tions 



. Slightly * Very 

Comfortable Uncomfortable Uncomfortable 



Pdsifi^e \, ' ,5 1 



; r Negative 



1 
0 



0 
1 



^ 0 

" 1 



» ^ 
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^ - ^ 

Quality education should help every child acquire, to the fullest possible extent, mastery of 
the basic skills in the use of words and numbers. ^ 



GOAL RATIONALE ; . ^ ^ . 

Mastery of the basic skills in the use of words and numbers is fundamental to 
achievement in all academic areas. Basic skills include the ability to get ideas through reading 
and listening, to handle mathematical operations, to reason logically and to respect evidence. 
The leveLof perfoAiance that can be reasonably expected in each of these areas will vary from 
school to school. However, it is of profound importance that the level of expectation inJ>asic 
skills for any group of pupils shall not be underestimated or regarded as fixed. . ^ 

MEASUREMENT RATIONALE . ^ ^ * . 

In- 1969 when Pennsylvania's Educational Quality Assessment Program centered on 5th 
and 11th gra^e students, schools could Iselect either of two standardized achievement batteries 
for measurement' in this goal area. It quickly became apparent that the use of these tests increased 
the length of the testing time so as to [cause great difficulty in scheduling and completing the 
entire questionnaire. 1 ♦ " 

Therefore^ the: use of achievement batteries was. discontinued and shorter verbal and 
math scales developed by Educational Testing Service which were group reliable were substituted.* 

c ' -In the verbal area assessment >yas cjirected.at the ability>to abstract or generalize and 
to think cojistructively, rather than at simple, fluency or vocabulary recognition. TftPitem type 
thought most appropriate was one using verbal analogies. 

The test ih the math area is directed at those mathematics skills and concepts all students 
should be familiar with and not Skills andlconcepts attainable only by academieilly gifted persons. 



GENERAL SCALE DESCRIPTION (VERBAL)* j - 

The grade . 1 1- verbal scale contains" 30 verbal analogies presented in a multiple-choice 
format. The scale is* timed (15 minutes)., The scales are- scored by ^ving one point for each 
correct afewer. No adjustment is made for guessing. 



♦Copyright (c) 1969 Educational' Testing 
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Sample grade 1 1 item: 

STEAM :TURBINE:: • ' ^ - 

A. vacuum: pressure . " • ^ 

*B. wind: windmill , * > 

C. water: power 

D. winch:c^||^ . * . * 

GENERAL SCALE DESCRIPTION (MATH)** 

The grade 11 math scale is. a 30-item timed test (15 minutes); ; 

Its" ability to disce^* specific strengths and weaknesses in math-related areas is limited. • 
Howevei^the test is conside^^d a good measure Yor >the general level of math achievement on 
a group^ Many items canTje done by arithmetic epmiputation, but often a conceptual approach 
is more expedient. A multiple-fcjioice fprmat is used for this scale. Each item requires students 
to make a size, comparison betw\;en two quantiti^. The scales aj^ scored by assigning one point 
to each corr,e'ct answer. No adjustment is macje for guessing. 



Sample grade 1 1 items: 
Column A ;* 
1,000,000 X 



i 

ColUT 



X V - 



A. T-he part, irf Columo/^^ is greater, , 

B. **The part in Colmiin; B is greater.^ ' " 

C. The two- partSy^e^ijfqual. :i 

D. Not enoughyimoi^nation'is given to,, decide. 

Column A / Column 



1/2 
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The part in Column A is greater 
The part in Colurrih B is greater, 
^*C. The two parts are equal. 
D. Not. enoqgh infomiatioo is given ^to/.decid^. 




GOAL IV .Interest in School and Learning 

Quality education ajiould help every child acquire a positive attitude toward tiie/kaming prdcess. 



GOAL rationale'^ 

The school represents i:|fejhaps the iTjo?t powerful single fprce in .determining a person's-' 
overall attitude toward learning. The climate and learning' atmosphere in the school, the educational 
experiences, the school provides and the^(^iMity o*f1he personal interactions it fosters between 
stucfent and ediicator^ all shape-- the students?' life-long attitudes toward leamin|. 

V ^ .-■ c * ^ ' ' - ' ' , 

Thejschool experience should be such that j^tudents^finid the learning activities associated 

wjth it enjoyaBfe'^^d rewarding to the pointjthat they are mdiivated to do well ^d to continue 

Itaming on their own initiative beyond the reqairemeiits of formaToeducation. Everything possible 

should be done tp^^nsure ^that the attitude of tfie teacher, the atftiosphere of the school, and» 

the schools physical conditioij-^^pn tribute toward tjiis end' so that the individual-both as a child 

,and later /as an adult-will hotd education high among his'^or her values. 



MEASUREMENT RATIONALE . 



In assessing student .feelinp about e<lucation, it is necessary -to examine inore than just 
those feelings within the context of the' students* ^present 'school experieftce. We must; also 
determine how this experience is influencing the students* general future attitudes. toward learning 
beyond the formal^ educational setting. The measurement device developed in support of this 
'goal attempts to sample student attitudes in two areas: The first relates specifically to the present 
school experience while the second focuses on learning as a lifetime process. 

GENERAL SCALE DESCRIPtlON* 

In: this scale there are 37 statements about 'the School, teachers and the learning 
experience. Eighteen items cast these areas in a favorable lightj«e.g.. Most teachers know what 
they are talking about. The remaining items are negatively stated, e.g., There is little I can do 
about the way this school is run. Response options available to the student are (1) strongly 
^gree, (2) agree, "(3) disagree and (4) strongly disagree. ' ^ • 

The total scale iSv/comprised of these subscales: ^ ' i. - 

Subsc^le 1: Attitude toward learning contains 10 items to measure the student's willingness 
to put fqrth effort to learn and to value continued learning throughout life. Sample 
* item: / /ry /6 learn things wherever I am. " , , • ^ 



♦The interest in school and /learning scale was developed by J. Robert Coldiroff, Division of 
• Edttcational Qualfty-'Asjessnfent. ■ . ' 
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Subscale 2: Attitude toward schoor contains 17 items to measure students' general attitude 
about **the school ^s an"^ institution. Sample item: The courses available in this school 
are extremely valuable l6 me. 

Subscale 3: Attitude toward teachers contains 10 items to measure students' attitudes about 
teachers' performance in classrooms.^ and students' relationships with teachers. 
Sample^ item*: Teachers talk too much in class. 



NORM-REFERENCED SCORING 

> 

. For norm-referenced scoring, the following weighting scheme is used 

Response Options 



Item Direction 



Positfve , 
Negative 

CRITERION-REFERENCED SCORING 



Strongly Agree 

■3 ■ 
0 



\ 

Agree Disagree Strongly Disagree 



2 
1 



r 



0 " 
3 



Responses are considered favorable if they reflect student agreement with positive 
statements about school and leamjng or disagreement with negative statements co'ipceming school 
and learning: A" student's score on ^ giyen- scale' (total or subscale) is the percenta^fe of items 
to which a favorable response was given. For this scale the^ scoring scheme applied to the items 

is: - ' - 



Item Direction - 

Positive 

Negative 



Response Options 
Strongly Agree Agee. , Disagree 

f . 1 ^ ■ • 0 

0 0 ^1 



Strongly Disagree 

■ 0 ■ 

I 

^1 • 



1 -a . 
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GOAL V Citizenship 

Quality education should help every child acquire the habits and attitudes associated with 
responsible citizeoship. o * • ^ 



GOAL RATIONALE , • • 

, Responsible .citizenship embodies a much more complex co'hcept than commonly^ 

expressed in love of country and participation in the*democratic processes. Viewecf in its broadest 
sense responsible citizenship implies a respect for law^^and proper authority,, a willingness to assume 
responsibility for our own actions and for those of the groups to Which we belong, respect for 
the rights of others and overall -personal, integrity. ' / 

Scfiools shi)uld encourage pupils to assume ^responsibility for their actions as well as 
the actic^s of the .group. Opportunities should be provided for pupils to cooperate and work 
toward group goals and to* demonstrate integrity in dealing with others. Pupils should be given 
the chance to take the initiative and assume leadership for group actio|ivas well as lend support 
to group ' efforts .as followers. / • * / ^ ^ 

MEASUREMENT RATIONALE . , ' ! , 

!?^';,Jhe mores,' codes,' laws an^ sociare'xpectations of society providp th^ reference Jxjints 
for^lSd^g which behaviors reflect responsive citizenship dnd which indicate poor citizenship. 
A revie w of literatui^^ revealed that the National Assessm'ent of Educational ^Progress developed 
nine general citizenship objectives. The criteppn for inclusion of an^ one objective was its relative 
importance no society. as agreed >uppn by i committee of scholars 'and lay people. 

- These, national abjectives were used to" provide the frame of refekence for what was 
to be measured. Objfeetives in the factual domain such as (%) knowing structure of goyemmerit 
and Ct)) understanding problems of international relations were*not considered in developing the 
scale. ; . . ^ * ' . ' , ' 



Arriving at a satisfactory defmition of .citizenship Was much less complicated tiian 
applying the definition to the assessment of students* attitudes and behaviors. Th^ display of 
responsible citizenship behaviors like honesty of integrity are most often situational. ' . 

A -person's display of good citizenship. behaviojv under one set of mt)tivating conditions 
tells us liftle about the way he .or she can be expected to act if'thdse conditions are altered'. ' 
The context in which the behavior is elicited therefore becomes at least as importanMn determining 
the outcome as tb'e predisposition of the individual involved. - 
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To assess citizenship, a beliavior-refejenced model, incoiporating element? related to 
the 'psychological notion of threshold is used. In reference to citizenship, threshold refers to that 
set pf conditions necessary 'louring about the desira^Me responses^. Thus by varying -the situation 
and Introducing conditions of reward and punishmeftt we are able to de^termine the cutoff levels 
at which the student wiU display positive behavior/ In this way it is possible to assess not only 
the students* predisposition to behave in a^mann^ consistent with responsible citizenship but 
also tp provide some measure of the intensity of that predisposition across a wide specttum of 
situations., . . ' ' ' : , . 

GENERAL SCALE DESCRrfnON* • ^ . r 

Fifty-seyen items measure willingness tct exhibit good citizenship In many social situations 
under a variety of motivating conditions. Socidl contexts are. given by 19 situations, each-posing 
a problem and suggesting an action predefined as gtfod or poor citizenship/ E^ch story has three 
Items which list positive or negative consequences resulting from the action. Student are asked 
to decide whether to take the action for each consequence. ^ *; ' 

^Sample situation (grade 11): There is a secret club at^ school called the Midnight 

Artists. They go out late, at night' and paint funny 
* ' ' ' .{ sayings and 'Pictures on i?uijflings. A student is asked 

V ; to join the cfcib. In this situation, I would JOIN THE 

„ ' CLUB when I Ichew;:.. , . . ^ - 

, / . Yes* • Maybe I^o * . 

Sample item set: . '1. My best friend asked me ^ ^ ' 

' ^ . ' to join. • . V . ' M N 

^ . i , 2. Most of the popular ^tudeht?*'* /: 

'v^ ' . . „ • '.were in thfe club. ^" * • ^ lA'^] N / ' 

' * ' ^ • 3. My parents' would ground- ^^mmiL." ; .* 

" * . me' if they found\^out I T * - ' 

■ ^ra : - • joined.- . \ ^T^ .'^'M/ > ^J^^ * 

. . - V , • - • 

^ The items within the scale are grouped to yield three subscale scores W'additioi? to 
a total score. * , , - ^ ; ' 

* * ' /. • > , . • 'I " ' ^ , 

Subscale 1: Conf ern for the Welfare and dignity oj^ others contains^ Ig'^items (item sets from 
five situations) designed to measure conceHi for IJie feelings of others, willingness 
to protest unjust treatment of others, and^ the tendency to accept new people 
into a group. Also Measured is the degree of restraint from teasing or degrading 
others. " ' ^ ^ . ' ' . - * 

Subscale 2: Respect for law and authority has 21 items measu^ng the willingness to report , 
law-breaking of others, obey authorities during emergencies and prevent classroom 
. • disruptions. Also assessed is the degree. of restraint from violent actions that could 
harm others or damage property. ' , ' ' . . • • 

... 

Subscale 3: Personal responsibility and integrity has 18 items which tap the willingness to honor 
self.made ' commitments to individuals ot groups an'd the willingness" tcT'take 
responsibility for one's o>yn mistakes and to 'report mistakes made in one sjFavor.' 

♦Nolan F. Russell from^the Division of Educational Quality Assessment is the author V the, * * • 
citizenship scale. ' T " . ' y 



NORM-REFERENCED SCORING 

The following item weighting scheme is used for liorm-referenced scoring: 



Response Options 



Yes. > 


Maybe 




2 


1 


0 


0 ^ 


S 1 


2 



Behavior, Direction 
Positive Citizenship 
Negative Citii^ienship 



CRTTERION REFERENCED SCORING 

Responses are considered favorable when tiiey reflect a willingness^ to display proper . 
citizenship behaviors, or an unwillingness to use poor citizenship behaviors. student's score on 
a given scale (total or subscale)^is the percentage of items to.v^hich a favorable response was 
given. For the citizenship scale 0ie scoring ^heme applied to the items is: 



Behavior Direction 



Response Options 
♦ Yes^ Maybe -r^- No . 



Positive Citizenship , . 1 , •^O 0 

Negative Citizenship t 0 0 1 



r 



i 



41 



23 




GOAL VI HesTtth Habits 

\ Quality education should help ev^ry chfld acquire good health habits and an understanding of / ^ 

the conditions necessary for maintaining of physical and emotional well-being. 



GOAL RATIONALE^ ^ ^ , ' . 

^ • In their own interest, as Well as in the interest of society at largQ|fchildren should 
know how to take care of themseWes and (how to keep physically fit. They sh6uld kn6w wh^t 
the requirements are for physical and mental health and what practices, harmful to*health, should 
be avoided. After gaining this knawtedge they should acquire habits which increase the probability 
of remaining healthy and fit throughout life. \ . . / 

^ In cases where the home has been deficient in encouraging the child to practice sound 
ealth habits, the school has an obligation to be aware of the situation and tasee that opportunities 
to remedy the deficiency ^re provided.^ , ' * ' ' 

MEASUREMENT RATIONALE 

' ' ; * * • . ^ 

Understanding how diseases and theij> prevention, dental care, j|(utritioo, ppfsonal hygiene, 
safety .and drug use relate to the structure and function of the hu*han body is an important 
first §tep in each individual's willingness to consistently exhibit habits which are conducive to 
the maintenance of personal health and well-bfeing. One does not rt6ed to be a doctor to display 
good health practices or ^ lawyer to display good citizen behaviors. ' . 

Therefore, assessment in this goal area attempts to get^at students' willingness to display 
proper health behaviors in a variety of situations. ' * 

GENERAL SCALEL DESCRIPTION* * . 

The pealing technique in this inventory is similar to/^the psychophysical method of limits. 
, This method holjis the. behavior constan^'while systematically allowing the stimuli 'to vary. The 
^ strength^ of the stimulus (in>physical units) which is required to cause a change in the behavior 
is used to define the threshold of that ' behavior. 

I' ' 

In the case of this health behavior inventory, the student is asked to decide whether 
^ he or she would take a given health-related action.. Each action is predefined. as indicating either 



\^ . *The health habits scale 'was developed by Nolan F. Russell, Division of Educational Quality 
Assessment: , , / ^ ' ^ - 
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good or poor health practice. Stimulus contexts surrmindingjtlie choices are systematically varied. 
The health-behavior threshold is defined in terms of the seve|rity of the stimulus contexts tolerated 
before changing from good to, poor health behavior. More specifically performance is Used ,to 
infer heajth-behavior threshold. by identifying the supportive contingencies in the environment 
necessary to maintain good health practices. / 

* . :,■'•/-- 

Sixteen situations 'in which a de^on can be made regarding one's personal health, safety 
se of drug^iare presented in this scale. For each situation the respondent is first asked. t(i 
der takin^ a specific action. In each question four motivation-inducing conditions, i.e., rewards, 
unishmerits, are made ' con tin gent upon the taking of the action. 



le situation: 



When a girl had the flu six months ago, the doctor prescribed some 
medicine. The' medicine worked so well .that she had some left. Now 
the giri thinks she is getting the flu again, in 'this situation, I would^ 
TAKE THE LEFTOVER MEDICINE *when I thought 



Sample* item set: 



Yes ' Maybe No' 



1. Taking it might save a trip to 





tfie doctor. 


Y 


M 




2. 


The doctor wouldn't want me to 










take old medicine. 


Y" 


"M 


N. 


3. 


There was a good chance it would 


Y 


' M 


N 




help." 


4r. 


It might be dangerous. % 


Y 


M 


N 



The items within 4hc scale were grouped to yield three subscale scores in addition to^ 
a total scale score. . - * ! • 

Subscale'/l : Personal and communitv health contains 20 item^(* five health situations). Content 
^ includes willingness to follow j)roper dret, to take proper medical 4)recautions, to 
' use good personal hygiene practices and to refrain from interpersonal-contacts when 

' • ' Ul. ^ ^ ^ "\ 

Subscale 2: Personal and communityy^fety contains 20 items frdm five health situations. 
• ' ^ Measured is the degree of restraint from unnecessary risk-taking at home, at school 
and at. play and restraint from submitting others to undue risks. 

Subscale 3:. Drugs contain five situations with 24 questions to measure restraint from (1) 
improper use of prescription drugs, ("2) experimentation with drugs 'and (3) 
maintaining close contact with others who are using 'drugs. Improper use of 
prescription drugs includes restraint from using old medicine, medication prescilbedJ 
for others, or more medicine *than has. been iJ^rescribed by the doctor. 



ORM:REF^EREN 




Fof norm-reference scores, the following item weighting scheme is used: • 

^ - Response Option^ 

^ * - Yes Maybe '^No^ 

. ; ' . 1 -i . 0 

> ^ 0*1 2 ' 



Behavior Direction f 



Positive Health Behavior 



^Negative Health Behavior 



CRITERION 'REFERENCED SCORING \ . - 

Responses are considered favorable when they^ reflect a willingness to take good 
healthjrelated actions or an unwillingness to display behaviors that might be harmful to health*. 
A student *s score on a given scale (total or subscale) is the percentage of items to Avhich > favorable 
response was given. For the health scale the scoring scheme, applied to the items is: 

Response Options 

^Behavior Direction \ * Yes Ma/be W6 

Good Health Practice . - A 0 0 



Poor Health Practice: v * . ^ i . -^0 0* 1 




GOAL V|l Creative Activities 

QuiMtjr eduction shtfuld give every chUd opportunity afid encouragement to be creative in one 
,or more>fleias of endeavor. .... "iv 

"1 . ■ . " * ' 

1 -' . , ' 

• GOAL RATIONALE ' • . 

. - • rV. - V • 

. The notion of creativity has" been'v^ously defined. It is used" here to encompass 
worthwhile- activities that children initiate and pursue on their own- activities having an outcome 
that IS perceiveid by .the .children themselves or by otiiers as a contribution to tiieir world Such 
activities tan .be founi in a wide variety 'of fields, not only tiie sciences and the arts, but also 
the organizatio| of human .affairs and th6 "development and exercise of salable skills in the 
production of practical tilings , tii^t enrich our way pf living. 



The school ..environment should encourage and reinforce^ activities tiiat can enable 
chil(h-en to express , themselves creatively' and productively. -' . . 

MEASUREMENT RATIONALE . ' ' 

z Attempts to assess creativity have traditionally used, methods which ' analyze tiie 
•compohents of the creative prodess br.sqbjective judgments abdut the quality^of tiie product 
of the creative ..act. Neither of these procedures. is particularly -weU adapted tS* a large scale 
assessment effgrt^whieh covprs ,tiie' broad spectrum of creative talent repre'sented in the schodl. 
.In order to overcome this problem a two-dimensional model of creativity was proposed which 
■ provided a tiieoretical basis; for the as^ssment of Go^ VIi: The first dimension is based on tiie. 
student-expre^ed interest in .participating in creative activities, while tiie secdnd attemptslo 
determme the extent of recognition gained flirough active involvement. This approach seems 
sound sihce tiie Qoal VII statement stresses^ opportunities and eaeottragement for all students 
^relative-to-creativity^rather tiiin-eliiphasizing indivjdual talent and production m any one area. . 

.GENERAL' SCA'LE DESCRIPTION* 



A. 



4£ 



• The creative, activities checklist contains 36 activities which require origlhality in-vdsli^ 

arts, performing arts, science and^writing. Sample activities include performing an oi^ginal scientific 
* experiment witii* living things, writing an original poem, modeling arl putift in^an original . way, 
,j)erforming an .original riiagic^or novelty acf. ~ . ' " .• ^/ 

' . • Resjibnse options give six ways .to show degree of involvement in each activik Options 

. .are (1) No; and have not wanted to; (2) I^o, but^have wantedjo; (3) Yes, butwitfi no recognition; 
• » i?' • • " • ■ ■ ■ ■- « 

- — I ' i> » . > , , ¥ .1 

♦The creativity.«scale ,was developed by James F. Hertzog and Nolan F. .RusseU,%tii from tiie * 
Division of Educational Quality Assessmeht. , ' ' . ' - • 
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(4) Yes, with teacher or adult leader recognition; (5) Yes, with^hool-wide recognition; and (6) 
Yes, with area-wide recognition. The scale cbntains four subscales each' having nine items. 

Subscale 1: - ' 

Visual arts contains n\ne items, some deding with more than one activity. Activities 
* include sculpturing; cartooning; printmaking; graphic design; painting; photography; ^ 
flower arrangement; design of window displays, stage sets, decorative items and clothing. 

Subs^^2: . ^ . . 

Performing arts contains ni^ items which mclude activities dealing with singing, speech, 
musics magic, modeling, directing, acting and sports. 1 < 

^ Subscale 3: - . - ' \ V 



Writing arts ha^ nine items related to writing such as poetry, news, essays, stories, scripts, 
letters, jokes and recipes. . . • . 



Subscale 4: 



' Science activities contains nine items such as performing experiments using physi(;al 
objects or living things, constructing models to show a scientific principle, ^xpjorin^^ 
-training animals,^ directing recreational^ activities, developing campaign strate^^SjJpr^/>^^ 
(school) elections, working with radios or other electronic equipment and^desigim 
gadgete. ^ : , < ^ . 

NORM-REFERENCED SCORING ^ ^"^ P^ '^^^^' ^ '^ '^ 

:.AI1 items in this scale are positively woided. Each item describes an activjti^.ars|^j£S „ 



the students to describe the level of their involvement in that acjivity 

iesponse-Opfiohs . Score Obtained V^Tf^ \ 



'(1) No, and have not .wanted to * . ' 0 \ 



(2) No, but have wanted to ^ 1 

(3) Yes,, but no^jecognition 2 
if) YeX with teacher recognition ' ^ 3 V*^^*; 

(5) , Yps, with school-wide^recognition ^ ^ I . ' ^4 ./^ 

(6) Yes, with area-wide recognition _ . 5 ^ v \\ 

CRITERION REFERENCED SCORING 



T wo ,'criterion-referenced * scoring methods are used for this scale. The first defines as- 
favorable, those choices which reflect a willingness to tjry tl^e activities presented in the scale. 
• Thus only the option J^o\ and have not wanted to is considered unfavorable. Scores generated 
,from this method are 'calle^T Attitude Toward Creative Activities. , \ \ 

* * . '* 

The second ^clieme defines as favorable th'ose choices indic^tin^ that the student has- 
actually participated in the activity. Thus two, choices 'are considered unfavorable: No. and have 
hot wanted to and No, bui have wanted to. \ ■ 
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60^ VIII Voe^ilDnar lOipWIedge 

Qijdfty education ^ould he^ eyery chik£ understand the opporhkftities open to hiiii or, her to 
mf^are for a productive ltfe:a|id help eafdh child to take fuD advantage of these opportunities. 

GOAL RATIONALE ^ . 

Students should be awaije of the vast array of possibilities Yor continuing self-development 
in. the vvorld of !work so that they will be motivated to purs^ejeiccellence in all forms of human 
endeavor- th^t; are appropriate for them individually. \ \ 

iWost children can profit from^ some form of educajtion b^ond high school, whether 
it be a. f0qr-year college, a school of - nursing;? a community college^*;ii technical institute or the 
.like. Each student should J>e_aware of these opportunities and'sg^i|^^,4he^kin^ of education 
' bes^ suited to his or her talents and mterests. Jhis joal^al^o impii^pf^f {he schDol-^ilLpravoHT 
students with guidance that will enable them'-'to do so. 



MEASUREMENT RATIONALE 



•Vocational developmenlTfor' purposes of assessment, is a series of processes- inVc 
both the acquisitiori^f knowledge about different kinds of work and the forming ofattftudes; 
which will enhance one's chances of succeeding in the work-a-day world. _ 

In the initial stages of vocational maturity students ' become aware of different kinds 
of work and workers. This is followed by a growing understanding of the relatedness of educational 
and occupational opportunities. The mor^\vocationally mature students will actively seek 
information, accept personal responsibility for career decisions and fmally base their career choices 
^upon a realistic appraisal of theijr. interests,*, achievements and aptitudes. 

Two separate sjisflfei -^yere^ developed' In this goal area. The first deals with attitudes 
relating to beco/nlng a ^roductiveJVorking member of society. The second explores the knowledge 
ba^e^ necessaryOtb make .appropnatfi ediidational-vbcatipnal decisions. 

GENERALiSCALE DESCRIPTION (VOCy^^IONAL KNOWLEDGE)* 

: Tbis .3Q-iteni instrument, measures sl^H to associate clusters of job interests, trait and 
ability characteristics specific occupations. Kls,o tapped is student awareness of duties, training 
and educational requirf^ments of various occupations along with an uujderstanding gf labor market 
conditions. Two separate i4^nse formats are used . within this scale. The first requires the student 
io match an •occUpation/tO^ cluster crfMntejj|^tv*traits anrdj^abilititiftrTlie^econd requires the 
student: to select the moslt /"appropriate answer frdin among four options. / 

- i ' ' ' - • 

♦The aiithors of this scafe are Francis J. Reardon and Gregory A. Shannon, Division of Research, 

Department *pf Education. , , . J. 

' ^ ^ 79 
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Sample matching items: ' - 

1. Well organized thinker; prefers td supervise; 
good critic of ideas;- good sense of grammatical 

y .usage. « , ) . ^ 

2. Prefers not to sit while working; good judge of 
people; .uncomfortable with audiences; independent; 
good busines$?^mind. 



a. policeman 

b. newspaper editor|^ 

c. writer 

d. insurance ^ 
investigaj 



Sample multiple" choice item: 

Which occupational area will provide the; 
ahead? 

A. service workere 

B. agricultura^^^kers 

C. m^mtfiicturing workers 
ratisportation workers 



test employment opportunities in the years 



NORM-REFERENCED SCORING (VOCATIONAL KNOWLEDGE SCALE) 

One point is given for each correct answer. There is no scoring adjustment for guessing. 

^GENERAL SCALE DESCRIPTION (VOCATIONAL ATTITUDE)* 

Twenty^ight items measure attitude tojvard work, careei* choice and . efforts at 
establishing long-range career and educational plans. Five items reflect a positive vocational attitude, 
e.g., Doing a job well, iiay in and day out, is important Jo me. Twenty-three items are worded 
tQ reflect vocational immaturity, e.g., 1^7 could live comfortably on welfare, I would not work. 
Response options are (1) agree, (2) mostly agree, (3) mostly disagree and (4)_disagree. The items 
are grouped to yield two subscale scores in addition to a composite score. 

'Subscale 1: Work attitude contains 14 items measuring willingness to ^ve Best efforts on a 
; job and belief that work leads to a sense of accomplishment in one's self. Sample 

V ' itemrr/ie prospect of working most" of my adult life depresses me. 

Subscale 2: :^^^reer planning has 14 items which examine the extent to which the student accepts, 
^ r .tile need for vocational planning and is willing to engage in career planning activities. 
Sam|)le item: My planning for a career is a waste of time, 

NORM-REFERENCED SCORING . . c 

For norm-referenced scoring, the item >yeighting scheme is: 



Item Direction 
Positive 
^Negativ^" 7 y 



Agree 
3 ^ 
0* 



Response Options/ 

Mostly Mostly 
Agree Disagree Dii 




2 
1 



1 

2 



0 

T 



"•^The 4ttitude-toward-wofk-ahd-career-planning instrument was developed by Nolan F. Russell and 
Richard L. Kohr, Division of Educational Quality, Assessment ' . 1 
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CRTTERION-REFERENCED SCARING 



J 



Responses are considered favorable if they indicate healthy attitudes toward work and 
a willingness to engage in career planning activities. An individual's score on a given scale (total 
or subscale) is the percentage of items to which 'a favorable response was given/ For the ' 
attitudp-toward-work and career-planning scale the scoring scheme for items is: 



Response Options 



Item Direction 



Mostly Mostly - % 
Agree Agree Disagree Disagree 



Positive 
Negative 



1 



0 0 



0 

1* 



0 



9". 
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GOAL'IX Appreciation of Human Accompliahments 

Quality education ^ould help every chfld to understand and appreciate as much as possible of 
human achievem^itt in the natural sciences, the social sciences and the humanities and the arts. 



GOAL RATIONALE 

Students should be encouraged and h^ped to ^n knowledge abo\}^human 
accomplishments. Possessing knowledge they wifl th$?n be' ready to receive and net to avoid the 
stimuli, that the .sciences and arts provide. At the next level, they wiU be ready to more clearly 
and consciously' perceive these stimuli and will begin to, discriminate among art forms. When 
they reach the next stage of (tevelopment, they will be ready to respond rather Ihan^merely 
attend to pfienomena-they will choose to see a-play, to read of a famous scientist or to conteYnplate 
the design of a building. . ^ 



Insofar as possible the school experience should provide an increasing openness to 
the life of the mind and an increasing ability Jp find meaning for one^s.rfwn'Iife^irL the heritage 
of the past and in the intellectual thrusts of the present age. * • 

MEASUREMENT RATIONALE * - . 

< Attitudes associated with the understanding and appreciation of human acdOiftpUshments 
' may be inferred from samplings of behavior taken at several points ^ong a response hierarchy. 
The lowest point in the hierarchy is represented by behaviors indicating a state-of passive receplBvity 
reflecting little more than an^awareness that certain human endeavors exist. At th^ higliest point 
of this hierarchy are overt be^raviors resulting in direct mvolvement in the activities and irtfening 
high motivation. Between these two extreme are several intermediate steps based on the value 
placed on the activities and willingness to receive stimuli that^these activities provide. 

In developing the assessment model to be used in this goal area, it was determined- 
that the instrument would not attempt to sample behaviors at either extreme. Instead items were 
designed to concentrate on attitudes .concerned' with the degree of value placed by students on 
^ . various areas of human accoitiplishment and t&e willingness of students to seek out environments - 
: where firsthand experience m! these endeavors would be possible. ^ 



^' ^ i \ 
GENERAL SCALE DESCRIPTION* 



f^cale cdptains 48 itpifls measuring how much value the students place on human 
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*TTie~apprecI^^^ scale was developed bj^Nqlan F.* Russell and Richard 

L. Kphr, Xixymoxi of*Educational Quality Assessmdnjr^ a^ Robert SgBV/ille, Bureau of Curriculum 
Services, Pennsylvania Department of' Education . "* ' 



'achievements in Ihe arts 'and science's and, the degree to which they are, willing to vicariously 
receive stimuli from' these endeavors. Areas included are literature^'^'art/'^athletics, ecology, 
government, science, mxisic and drama. The scale is orgaiiized into two subscale^s each '^haying 
24 items. . ' * , ' ^ - . 

SuSicale 1: . ' ^ • » <' 

Kfl/w/njh measures the amount of importance. tKe student attdchies ,to achievements in 
the arts and sciences arid how much the s'tude'nt values the-rdle played by people in 
tjiese areas. Sample item: Most scientists dont care:fiow their work affects people. 

Subscale 2: , - « • - . 

Receiving measures willingness to learn \nore about achievements in the arts and sciences 
and to^seek out firsthand information on what people in these areas are doing. Sample 
item: // would be fun to watch ^people paint at an art sttidio. 

NORM-REFERENCED SCORING 

The' item weighting scheme used for norm-referenced scoring is: 

• ♦ ' ' ' Response Options - 

^ . * k' ' - * 

Item Direcfton ' Agree Uncertain Disagree 

Positive * > 2 . 1 , " v'' • 0 

Negative 0 1 • 2 . 

» CRITERION REFERENCED SCORING ; ' 

- ' ? 
Responses to this scale are considered favorable when they reflect agreement with 
statements which (1) stress the value of human endeavors in the arts, sciences, politics, etc., 
or (2) suggest that it is personally rewarding to approach the people and places associated with 
these endeavors. For the appreciation 'Of human accomplishments scale tiie following scoring 
scheme is used. 



Item^D^reciion 
Positive Statements 
Negative Statements 



Agree Uncertain . Disagree 

- 1 . 0- 0 ., 

0 0 1 



GOAU.X Coping with Change 

Quality education should help every child to prepare for a world ofrapid change and unforeseeable' 
demands in which continuing education throughout adult life should be a normal expectation. 



GOAL RATIONALE 

Ability to cope witji a rapidly changing world is impojiant for today s youth. The 
development of the abilities and their associated attitudes which allow the individual to view 
change as an opportunity rather than a threat poses a new challenge for education. 

Schools should help students develop attitudes of openness to the possibilities of change 
-chan^^ in their personal world as well as extemd change. Students should be encouraged to 
show tolerance for uncertainty and to welcome .new experiences'! 

MEASUREMENT RATIONALfi 

Ability to cope with change and deal effectively with frustration is essential to pnersorial 
adjustment. These adaptive behaviors are seldom learned in response '.to external changes of great 
magnitude and import but are acquired as part of a gradual process requiring daily changes 
in the life of the student. m 

» - ' • *. 

^ Assessment in this goal area attempts to draw upon several elements believed to be 
,ASs6{?iiated with a student's ability to accommodate change and to adapt emotionally and^ 
behaxiorally to unexpected or sudden alterations in the environment. Primary among these are 
. measu^Bs of.the student s ability to tolerate frustration and uncertainty and to apply past learnings - 
and coding .behaviors in new and different situations. 

The situations presented as a ineans of measuring these attitudes and behavioral 
dimensions were gleane'd from student responses to open-ended questions asking for descriptions , 
of events they had experienced which necessitated some forni of adjustment and which were ' 
remembered as' being difficult to cope with. , 

GENERAL SCALE DESCRIPTION* 

Forty ilems measure emotional and^havipral reactions to change. The scale's format 
^contains eight stories describing unpleasant 'Chan^e situations in which student's expectations or 
needs are not met. These situations were obtained from previous student statements describing 
events that were^ difficult to adjust to. Five reactions predefined as indicating positive or negative 



* The preparing for a changing world scale w^ authored by N^n E Russell, Division of Educa- 
tional Quality Assessmej^i 
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adaptati(^s to change are given following each story. The purpose of th# scale fs to get at student 
reaction/ in response to a variety of events, not to predict what students will do tn the particular 
situaU^ns presented, - * - ^ 

' ' r ' . * ' 

iple^tuation: I was elected class^ president. I cam^e home to tell my pai:ents the good 
news. They tojd me that tny ,^ad ^fad taken a job out of state and we 
were going to move in two weeks. So I had to withdra'^ from school 
, , and move. , ^ ' * 

Sample items: If this happened to you, how much time would you spend on each thing 

listed ^elow: , * • 

A Great , Very " 

. ' Deal of Time Some Time little Time No Time ^ 

I, ^ Being upset, , ^ 



2, drying to find someone * 
to stay with so I could 
remain in my school. i 

3. Planning a going-away party. 

4. Fighting with my parents. 

5, ' iCeading about the place we 



are going to move to, 



"-^ 

Subscale 1: , Effective solutions contains ,13 items to measure the tendency to try solutions 
* reflecting positive adjustnfent t<!^change. In the a^^, sample items three and five 
%re assigned to this subscale. ^ ^ ' ' ^ 

Subscale " . Ineffective solutions contains 13 items to measure tendency to avoid use of 
aggressive or withdrawing reactions in face- of change. In the above, sample items 
two and, four are assigned to this subscale. ^ 

Subscale 3: Emotional adjustment contains nine items to measure the pferception of the length 
of time needed for the student to adjust emotionally to change. Item one above 
"is assigned to this subscale. 



NORM-REFERENCED SCORING 

The item weighting scheme for norm-referenced scoring is: 

3^ * Response Options 

a 

type of Items A Great Deal of Time Some Time LittleBme No Time 

Effective Solutions ' . ^ 3 2 1 ' 0 • 

Ineffective Solutions ^ ' 0 ,1 2 3 

Emotional Adjustment 0 1 2 3 
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CRITERION-REFERENCED SCORING - 

Responses are considered favorable when they reflect (1) a wiUingne^ fo adjijst 
positively, (2) an unwillingness to withdraw or become aggressive and (3) i rapid emotional 
adjustment to change. An individual's score on a given scale (total or subscale) is the percentage 
of items to which a favorable response was given. The item weighting , scheme (ot ttifi preparing 
for a changing world scale is: ' ' 

Response Choices • ' . 

. Very 

A Great Sorhe Little No * ^ 

Item Type \ Deal of Time Time \ Time . Time^/ 

Effective Solution * j j , q , 0 

Ineffective Solution o 0 0 1' \^ 1 „ 

Emotional Adjustment 0 0 ' 1 ' T 
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THE OVERALL PICTURE 



.^During the first .two weeks of March 1974, 48,274 students attending 191' 
Commonwealth intermediate schools completed the Grade 11 EQA Inventory. This is neatly 
a quarter of a million hours of student time. Do the outcomes which are Summarized by the 
Manual for Interpreting Intermediate School Reports accurately reflect student progre^ss on the 
10 state education goals? T6 answer this question one must tonfow where the tests came from, 
what they really measure, haw accurately and reliably they measure it, and how much influence 
faking and response bias have on the final results. The foUowing two sections highlight the 
safegtiards used to produce high quality instruments and show how the instruments stood up 
to these checks. • . - . • ' 

A WORD ABOUT ATTITUDES 

Attitudes, beliefs, values, etc., are abstractions. Nevertheless- they are real enough to 
each individual holding them. They are typically thought of as a state of readiness-a predisposition 
to act or react in a certain way when faced with certain situations. A, persons attitudes are 
^ways present but remain dormant most of the time. They are expressed in speech or other 
behavior only whe'n the object of the attitude is perceived. A person may have strong attitudes 
for or against astrology buj actively express them only when some issue connected wfth astrology 
arises-or when confronted by an attitude scale ! Attitudes are often reinforced by beliefs (the 
qognitive component)- and attract strong feelings (the emotional component) that will lead to 
particular behaviors (the action tendency component). 

The measurement of attitudes always involves making inferences, Sincfe^the attitudes 
cannot be seen or measured directly, we must infer their presence from consistencies that appear 
in the individual's behavior. Observing individuals across time in everyday situations is probably 
the best way to leam how the individual thinks, feels and acts. 
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Clearly, this method is much too cumbersome and costly when we want to investigate 
the intensity and direction of attitudes for a large number of people, forcing us to rely instead 
on verbal reports of the individuals concpmed. * ' % 

WHAT ABOUT PAPER AND PENCIL TESTS OF ATTITUDES? 

The use of paper and pencil techniques for measuring attitudes is often'.questioned. 
These questions are directed at both the test and the "test taker. Test critics are iioncemed with 
the possibilities that: 

L People misunderstand what the items are asking."" 

2. People don t always tell the truth on this type of test. 

4 

3. Scores on tests of this type are se|dom presented in any meaningful way. 

4. People ihight not, respond consistently to similar questions, 

5. . People might respond to items differently at various tinjes. 

In the development of the EQAI scales, these and ptKer cohcems were taken into consideration.- 

From the outset, all pilot instruments were put through an obstacle cc^rse of checks 
and balances designed to determine- *their susceptibility to various errorjs of measurement- The, 
tests wei:e thfii revised and submitted Ao additional field trials, Thfe philosophy of testing the 
tests before using them to. test people resulted in a five-*year developmental period requiring strong 
cooperation between the Department of Education and over 175 Commonwealth school districts. 

■ 



YES, BUT CAN THEY READ IT? • * 

. If stu^dents- can't read the tests, the tests can't read the students. Although it is impossible^ 
to, eontrol- the range of verbal comprehension in a program assessing over ^0,000 students, it 
is feasible to develop, scales that can be read and understood by the vast majo^ty of respondents. 

Toward this end, monitors conducting field-trials were required to submit detailed reports 
on the understandability of directions, item sentence structure and.vocabulary for each instrument* 
Also, students <were asked to comment on the scales and identify words and/or items that didn't 
make sense to ,them.. 'Changes resulting from these data increased the readability of all EQA 

instruments. . ' - ' ' ' 

\^ . ' 

After each scale was finalized, its readability level index was estimated by the 
Gunning-Fog formula. This formula takes into consideration both the average number of sentences 
and the percentage of three-or-mord syllable words contained in lOO words. The index is expressed 
m.grade level terms. An instrument with a^readability index of 5.0 should be understood by 
the average student just entering 5th grade. Seven scales within the inventory have Gunning-Fog 
readability indices ranging from 4.0 through 5.0. The creative activities and appreciating human 
accomplishment scales have readabilities of 6,0 and 6.7 respectively. The reading difficulty for 
the citizenship and health scales is Computed at 6.9 and 7.2 respectively. 
My 

FROM ITEM CONTENT TO ANSWER SHEET 

Handing someone a list of attitude questions, waiting 10 minutes, then collecting it 
does not insure that the check marks you find in the answer column were made solely in response 
to the content of statem.ents on the list. Those other factors influencing answers are called response 
sets. The two most common types of response set contamination are the tendency of respondents 
to tell you what they think you want to hear (make a good impression) or to randomly check 
answers without regard to item content. 

In their developmental stages^ all scales and items were checked against a special 36-item' 
instrument^ designed to picki^p the tendency to make socially desirable answers. This scale* 
contained such questions as\ 

( 1 ) / never forget to say please and thank^ you. 

*(2) Sometimes I don't like to obey my parents. ; ^ 

(3) / always finish my homework on time. 

(4) Sometimes I do things I've been told not to do. 

Those items and scales whose scores were found to beassociated with socially desirable responding 
were deleted or revised to minimize the relationships found. The correlations between the final 
total instrument scores and a 30-item version of the social desirability scale^range from .1 1 through 
.19 (N=460). , ^ , . ' ' 

r * 

have tried to minimize the effects of ^osition bias by including both positively 
and negatively ,worded items in the 'goal scales. The creative activities check-list is the only EQAI 



*ltem sources for this instrument included the Ctpwn-Marlow Scale (1960) and the Childrens* 
Social Desirability Scale by.Crandall (1965). ^ • ^ ' 
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instrument which, does not ^ contain reflected items. ^i«n estimate of response position' bias can 
be deterhiined by counting the number of perfect s^>es. To get a perfect score the student 
- must answer Yes, I havcidone this activity and have recefve'd, area-wide recoginition /or its quality 
to each of 36 separate^activities-a higfily questionable feat! Fewer than one-Salf of one per 
cent &{ nearly 50,000 respondents ol?tained a perfect score on the scale. 

FROM ITEM ANSWfks TO TEST SCORES. \^ \ • 

To give school personnel a clearer picture ab6u^, the^e*fiWmance of their students on 
the EQAI, two scaring methods\aje used for each attitude scal^The firs^t scoring method organizes 
the response options with each spale, into a hierarchy. Differen| scoring weights are then applied 
to each level of ^the hierarchy. Consequently, for an item^^ as / like school with response 
options (a) stron^y disagree, (b) disagree, '(c) agree and (d) sffoi^/a|;ree^ weights of j^ero through 
four are . applied respectively to each answer choice. This method "i^ based on the assumption 
that strongly agreeing with a statement is morfe positive than merely agreeing with the statement. 

Item scores obtained by this method are summed 5hd used to give norm-referenced 
information about student performance. How well a group of students perform on the scales 
is determined by the relationship of. their scores to other student groups. This^norm-performance 
tells very little about favorableness of student, responses. , ^ - 

To obtain information abput favorable and unfavorable responding, a 
criterion-referenced scheme is used. This scoring method is based oij the notion that each item 
within the scale offers the respondent the chance to show a positive or negative attitude toward 
tlie specific content presented by the item. Hence, the response choices to the above item are 
scored by assigning a one to both the strongly agree and agree choices and a zero to the remaining 
choices. 

The number of positive responses given by each student is compared to an independently 
determined standard or criterion. If the number of favorable responses meets or exceeds the 
standard, the student is said to have achieved the standard. In the case of scafes used in EQAI, 
three criteria were set: Level One requires students to respond favorably to mqre than .35 per 
cent of the items; Level Two requires favorable responses to more than 50 per cent of the 
items. Level Three requires favorable responses to more than 70 per cent of the items. 

RESPONSE CONSISTENCY WITHIN THE TESTS . 

Reliability is that characteristic of a measuring iristrumenl which deals with consistency . 
of . results-either within the scale itself (internal consistency) oBiOver time (stability). Reliability 
coefficients are reported as iwo-place decimal figures ranging from .00 to 1.00. As the instrum.ent 
increases in reliability the coefficient increases in value. 

Rehability coefficients ar^ interpreted as the proportion of Jhe variance in a set of 
scores which is caused by variation in the jexaminees true scores, rather than by errors of 
measurement. ■ . . ' 

The coefficients are derived by" taking intcr^ccbunt the length of the test and the extent 
to which test items contribute mutually confirming'^ or consistent information. 

The KR-20 reliabiKty formula is used for 'the knowledge scales scored on a right* vs.* 
wrong 'hasit For the attitude scales, coefficient alphas give us estimates, of scale and subscale 
internal consistency. .Internal-consistency reliabilities based, on criterion-referenced scoring of the 
scales are obtained using Livingston's formula.* As the magnitudes of, these coefficients increase. 



^Livingston, Samuel A., Criterion-Referenced Applications of Qassical Test Theory Journal of 
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we can be more confident that errors .of measurement are unlikely to make a difference between 
meeting or, not meeting Ihe criterion for many of the examinees. 

Table 1. presents seven separate internal consistency/estimates ibr each sub and total 
EQA scale. These 'are based upon a sample of 3,-300 student records randomly drawn from all 
191 schools administering the inventory in March 1974. Therefore, these reliabiUfy findings can 
bfe. generalized across various schools, communities and test'sQttings within the Commonwealth.*- 
Sub knd total scale names are presented in acronym form. For completJe names refer to Section 
One, ^ j * • - . . ^ ^ ' ^ . 

» To- clarify test appropriateness for students 6f differing reading and achievement levels, 
<:oefficient alphas are .given- f6r l6\v achievement (N=^ 1050^, average^ achievement (N=ll25)and 
high achieven^ent (N=l K25) students groups. These groups are defined l)y scores on the composite 
math-verbal scale. ' 

As^a rule of ^thumb,- ^elley* hasproposed that tests designed to discriminate between 
groups should Misplay'^^liabiUti^s ^greajpf'^an .50. Column five of Table 1 shows that all of 
the 1^ total scales have internal re Utilities higher than Kelly's proposed njmrraum figure juid 
range from .82 for the Basic Skills Math Scale .to, a high of .93 for the Goal V-Citizenship Scale. 
Nolte thai only one subspale (CONTENV) fails to meet this minimum criterion and then only . 
for the l6^^ability student grouping. Also evident from Table 1 is the increase in reliability foV^ 
*most scales as ability levej increases and the high reliabilit/ obtained oh ail total scale scores.* 

*" ■ • * 

The three extreme right columns of Table 1 show criterion score reliabilities of 3,300 
• records 'across the tfiree criteria levels. Here again the reliabilities are very high. This indicates 
'that^hp^ tests ,are capable of eliciting consistent responses from students. ^ 
• . ■ ' * . ^ 

Other indicators of fntemal consistency available in printout form at the Division of 
Educational -jQuality Assessment in Harrisburg are ratio#Setween standard-eir pr^of jiea^urement ^ 
anci st'kndard deviations, average inter-item correlations and items-to-total correlations for all sub 
and total scales. These indicators confirm conclusions obtainable from Table 1. ^ 




•t . 



T, L. Kelley, Interpretatiorrof Educational Measuren^ej 
•World, ino.^ t97» ' , " 
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RESPONSE CONSISTENCY OVER TIME ( 

Two cquestions relate to stability of test scores.-- Do students star in the same rank 
order position relative td one another from one test occasion^ to the next? Do students \v^o 
are classified ^ having positive or negative attitudes remain in their respective categories across 
testing occasions? The first question is answered by computing correlations betwjeen the two test 
scores obtained at different points in time. The latter is answered* by adding the percentage of 
students who stay in the favorable attitude classification with the percentage remaining in the 
unfavorable classification. * 

In February and March 1974, data on test stability for nine of the 12 scales ovep ^ 
four and one-half week period were obtained from '490 llth grade students in a large school 
district in southeastern Pennsylvania./Test administration followed procedures, recommended m 
the EQA statewide Monitor's Handbook. A second study involving 1 10 students attending a school 
district in western Pennsylvania , produced stability estimates for the remaining three scales. 

^ , , ' " ^ ^ ' ^ \ ■ \ . ^ 

Table 2 presents test-retest correlations developed from norm referenced scores on all 
sub and total scales. An index of continuity for scores x)n each of three criterion scoring leyels 
is also given. This index tells us the pef cent of students remaining in the same scorinig category 
(i.e., those passing on Tthe first occasion who also pass on the second occasion or those f^ng 
on the first occasion, who also fail pn< the second occasionr). From this table it can be seen 
that the total scale reliabilities are quite high and range from .66 through .84. The continuity^ 
index figures show that a large percentage^- of students don't change their answers sufficieptly' 
across testing occassions to, be placed in a different > category. ^ . 
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TEST-RETEST RELIABILITY AND c6nTINUITY INDICES 
FOR SUB AND TOTAL EOA INSTRUMENTS 



Scale Name 



Test-Retest Reliability 



A. 

4 . i ' . 

Indices of Continuity 
(Criterion Scoring) 
Level One . Level Two Level Three 



CSELF 
CONTENV ■ 
, RELATE S 

SCHLIMAG 
. TOTAL SCALE 

RACE , 
. RELIG 
SES 

JNTELL 
HANDCP 
TOTAL SCALE 

GOAL-3V 
qOAL - 3M 

LEARN 

SCHOOL. ^ 

^ teacheRs^ 

TOTAL' SfcALE • 

' WBLEDIG 
LAWAUTH 
RESPINTG 
TOTAL SCALE 

PHtALTH 
SAFETY' 
DRUGS 
^ TOTAL SCALE 

VISLART'^ 
' PERFMART 
• SCIENCE ' '\- 

WRITING 

TOTAL SCALE ^ 

-WORK 
' CAREER 

GOAL 8-A TOTAL 
GOAL- 8K - 
VALUING 
RECEIVING 
TOTAL SCALE . 



.79 
.62 
.75 
.82 
.83 


4 


91% . 
96% ' 
95% 
87% 
96% 

t 


85% - 

86% 

85% 

" 84% . 

. .89% 


83% 
82% 
"••83% 
82% . 
88% 


.75 
.74 

* ' .69 

* .68 

.68 • 
. .78 


% / 


94% ■ 

90% 

93% 

86% 

89% 

94% 


88% 

81% 

82% . 

74% 

8i% 

88% 


81% 
80% 
, 78% 
■ 75% 
76% 
79% 


:82 
.81 


• 


.N.A. 
N.A. 

91% 

' — 
• • 79% 
. ' 95%' 


' • .n.a;„ 

. n:a. 


N.A. 
N.A. 


'■ . .71- 
.77. 
.69 
.78 , 




76% 
— 83% 
^ 73% • 
^ 86%" 


77% 
76% " 
80% 


' -- .76- . 

>- - -7.8 , 
: js ': 

':. \ % 




78%- ■ 
77% 
76% . 
78% 


. 81% . • 
• 80% 
82% 
^ .82% 


. 81%;-. 

87% • 
89% 
~" 85% 






71% . 
• 79% 
. • 81% 

A ■ 82% 


83% 
■ 70% 

74% > ' 
» 79% 


91% 
85% . 
88% 

-. 80% 


: M- 

.62 
..66. 


\ 


" " 82% 
74% 
'82% 
77% 
86% 


" >75% ♦ 
81% ^•■•v. 
78% ■ 
80% ,.v 

^ 73% . 


, -$6% 
73%-- 
85% 
. 82% • 
/'•76%^ 


-.79 
- .79 

;73. 
.7.a' • 

..7'6 >. 


N 


83% 

87%r 

- 86% 
. " • • N.A. 
N.A. 
N.A. 
' N.A. 


91% 

79%^ 
-* 80% .' 

■ . n.a: 

• n-a. 


74% 
84% 
. 84%- 
"N.A. 

'n:a. 

N.A. 

.N.A.-'- 
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WHAT IS VALfDITY^ ^ . - / 

Validity is evidence-evidence that helps us separate fact from fiction concejni^jg.test 
results. In the case of ther Educational Quality Assessment Program, information on the validity 
. of each scale can help state educators translate the paper goals' and nunihet outcomes into a 
better understanding of Pennsylvania scfiool a^. children. No single proccfdure or experimental 
design gives a complete-^ipture of a test's validity. Instead .eaclT study, in its own way, helps 
round out a picture, of ;^hat , each instrument measures and, therefore, aids our interpretation 
of test outcome^/--:?^'.]'' » . 

Most .test manuals at some point address themselves to questions of validity and 
reliability. Underpinning these concepts are the more basic questions of th^ interpretability and 
usefulness of information engemjered from the test The internal structure characteristics of the 
EQAI instruments which are pS^eptedViri Section 3 offer initial evidence of the tests*^ useability 
by Remonstrating empirically that the scales can elicit consistent student responses both- within 
sets of similar items and across time. Low susceptibility, to faking and ease of readability also 
support the pfemise^-lhat the vast y^dj^lAXy of Uth-gra^e students can interact eajsily with the 
battery in the te§l^ettin£. 

The internal structiire of tests also qan be examined by asking students to describe 
•their general reacdons to each' scale and askingTirofessioni^ educators td judge the appropriateness 
of contents of each scale. * .Lv '^'::rr:'.^ ^ - 



ALUOyiiSG STUDENTS tO REACT TO THE INVENTORY 

i . ' . During fielcftesting, a six^statement questionn^re was inserted at the end of each 
proposed ]|QAr*3cale. Students'' who were^lectefl to>|^pond to the questionnaire represeated 
a range of high, average and low socioeconomic backgrounds attending urban, suburban and iriral 
schools. Approximately 300 students per EQAT scale responded , to the special questionnaire. For 
example, students who had completed, the GoaJ^I-Self-Esteeni' s;:ale^ were*asked; 

Ij^J. In general do you feel that the , questions get at • 
t self-understandinglC' ' *" • 

) (Please circle Yes'^^oa No) 



2. * Do you think you answered these questions honestly? 

(HeasMircle Yes or No) 

3. Please write a sample question Jhat would better reflect 




self-understanding. 

* . « *^ « ■ ' 

• ^ 4. Go ,bqgk through the scale dhdJdentify those staternents which . 
" ^-^^ 3?0M^"^lfr-^^CM//j' understanding. Please write • down the 
question numbers. , " y^^* 

5. Please Jist the words which you had diffidulty understanding. 

- General comments. Here is a chance for^you to write any 
comfftent}' yoti fnfght fiavHabhut this scale. ^ 

, Data obtained from this procedure were used to refine the instruments and to obtain 
estimajes fafe. vaiditl^S^e percentage of- respondents agreeing that particular tests\ appeared 
to refleqf the tmtf:o£ intef^^^ from 93 .per cent for the creative activities scale' throu^ 

98 per cent for the GoalHLmatheifmti(» te§t. An average 96 per cent felt that they had responded 
honestly to test items. Responses to question six indicate^ that fewer than 5 per cent of the 
students- felt that tim,e spent completing the scales was^ wastfed (i.e. they thoujjht the tests were 
stupid, not relevant, or unrealistic to their personal lives.) ^ . - 



JUDGMENTS OF TEST CONTENT BY EDUCATOkS • 

When constructing tests to be used ih* a statewide assessment program, it is extremely 
important to make systematic efforts to insure that item and scale content are both logically 
and empirically related to the cpncepts they are 'designed to measure. From the outset, content 
specifications were developed for each goal area. Items and test formats were then designed to 
reflect these specificatiorts as closely as possible. Working papers for each instrument-describing 
its. item development and selection procedures-together with its content map, are available at 
the office of' the Division 6fi Educational Quality Assessment in Harrisburg. 

During all stages of test development, curriculum specialists ffom the ^ Department of 
Education, together with .measurei^ent researchers and local school disteict personnel, judged item 
"content, scope and appropriateness'. In addition, 40 teachers and adm.imstrators from the Cariisle 
Area School District who had ^ undergone a 1 5-hour training program in quality assessment 
procedures were as^^d to rate* each final instrument in terms of item and content appropriateness. "^' 
The lowest agreement of content appropriateness was found for the creative activities scale (90 
per cent thinking the test adequately measured the concept). Betjyegn.93. and 98 per cent 
agreement on content appropriateness was obtained for the other jK^fles. ^. 

STUDENT SCORES vs TEACHER PERCEPTIONS , ;i V 

. The m^jor purpose of the quality assessment procedure is to identify .stud^f .progress! 
in the 10 quality education goal areas. This will enable educators to more clearly focus curriculum 
efforts on student strenghths and weaknesses.^ The ability of teachers to identify studeilt needs 
by classroom observation techniques is germane to meeting studejjt needs or maintaining already 
high levels of student achievement. An important question in this Vegard W. Do student test scores 
correspond to teacher judgments based upon observations of student -classroom behaviors?. 

Faculty and administrators from both the middle (N=8) and senior high schools (N=20) 
of Carlisle Area School Disfrict participated in a 1 5* hour in-service workshop spoiteored jointly 
by the state educational department's Bureau of Curriculum Services, Capitol.Area Intermediate* 
Unit and the Carlisle Area School District. Trailing was conducted $y Division of Quality^ 
Assessment personnel and was designed to commWicate the nature and substance 'of fhe' EQA 
program and to familiarize teachers )vith goal measurement rationales and test conteiit. 
Concurrently the entire student body at both grades 8 and 1 1 completed appropriate forms of 
the EQA. Inventory. After initial training in classroom observation techniques, teachers were asked 
to nomiii^ the highest 20 'Per cenFand low estJlO per cent of their students in the areas of 
self-esteem, tolerance, attrfbae toward school hgalth^^habits, creative 

^performance, work attitudes and coping witli clS^e. * . , 

Each studen^t was the*n assigned a score based on the aumber of,high\orlow nominations 
the student^ received. Each score was a ratio formfed by taking the number of positive high 
hominations minus the number of negative low nominations divided* by the number of possible / 
nominations. Distributions formed irom these scores were Jhen examined in-order to place students ^ 
into high and low groups for the purpose of analysis' ' 1^ - 

^ ♦ The number of students in each group varied from goal to goal and typically ranged 
from 81 to 100. Differences in giean scores between the high/low groups wefe statistically evaluated 
via a series of Fisher-Behiins t tests which correct ,for biases assoi:iated with unequal variances, 
when sample sizes are unequal. * . , ^ " ^ 



Table 3 presents the mean scores for the high 'and low teacher nominated groups, the 
t value along with its associated level of statistical significance and the point biserial correlation . 
coefficient between group, membership and scale scores. Scale names are given in acronym form^ 
As can be seen from the probability column, studej^t scores on five of ,the seven composite 
instruments are significantly related to teacher perceptions. 



■ - \ 

Statistically significant relationsljips between teacher perception of classroom behavior 
and test scores are found for the total scale and each subscale for Gpal l-s€f!if-esteem. Goal 
IV-interest. in school. Goal V-citizenship and Goal Vlll-vocational attitudes. This indicates that 
teachers were readily able to observe characteristics in their students which w6re also picked 
up -by the student*s responses to the tes.t items. The relationship found for Goal II is significant 
for the total scale and four of the five subscales. The religion subscales failed to reveal significant 
differences. . Only one subscale for Goal X-c6ping with change was significant. The visual arts 
component of the Goal Vll-cteative performance scales showed a reliable relationship with teacher 
perception. 

Table 4 gives a criterion-referenced perspective to the resultl^ of^e Carlisle study. The 
per cent of students passing at each of the criterion scoring levels > for high and low jroups are 
shown. Also given is the difference in the per cent passing between the groups and the level 
of statistical significance of tttKdinerenGe based on test results. ^ , . ' * ^ 

Seven of the eight instruments investigated in this study show the ability to discriminate 
between ^teacher-selected high and low groups on at least one, and in most cases more than one, 
criterion leve}. - ' » \ ' 

The combined norm-referenced and criterion-referenced results give strong support to 
the notion that teachers, through close classroom observation, can identify generally the same 
students that the tests show to be above average or below average on the seven general traits 
measured by the^EQAI. 
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TABLE 3 



f CORRESPONDENCE BETWEEN ^EACHER NOMINATIONS AND 

> TEST SCORES FOR SEVEN EQA INSTRUMENTS 



SCALE NAME 

* 


H Group 


• • 

L Group ^ 


Statistic ^ 


f 

Prob. 


St. Biserial r 




CSELF. • 


19,78 


17 21 


(3.46 


0001 






CONTENV 


21.66 


18.82 


5^2 


0001 


36 




RELATE 


20.56 


18 23 


'3 §8 


0001 ' 






SCHLIMAG 


18.71 


14.29 


6 01 


OOOIr 


' 41 




GOAL I TOTAL 


80.72 • 


' . ^8!59 


5.82 


.0001 


.40' • 




RACE ; 


14 39 


• 


3 1 1 


> 

* noi 






REUG 


13.03 \ 


12 4Q 


91 




fu: 
.uo 




SES* 


13!97 


13 06 


2 32 




17 




INTELL . 


1236 • 


11.42- 


2.10 




.15 




HANDCP 


14.15 


13.02 . 


2.40 


.01 


.17 




GOAL II TOTAL 


17 93 


62 58 




001 


10' 




LEARN 


18 S4 




6 ^6 




AA 


1: 


SCftOOL 


31.93 


.26.99 


5.01 


.0001 


\35 




TEACHERS 


16.19 


13.85 


4.41 ' 


.0001 , 


.32 




GOAL IV TOTAL 






6 44' 


0001 ^ 


.*Hr 


A. 


WfiLFDIG ■ • ' 








0001 






LAWAUTH . 


28.57 


21.51 


5.73 


.0001 . . 


' * .41 




RESPINTG 


26.23 


20.30 


5.47. 


.0001 


.39 .. 


1 


GOAL V TOTAL 


79 83 


62 12' 




nnni 






PHEALTH 


25.66 


23.72 


1.65 


N S 


14' 




SAFETY 


29.38' 


- 25.24 


3.46 


.0005 * 


> .28 




DRUGS 


35.71 " ■ , 


29.28 


3.96 


.0001 


.29 




GOAL VI TOTAL 


90.74 


• ^ 78.30 


3.63 


.0001 ' 


^20 




WORK 


32.28 


.27.5^- 


4.93 


!oooi 


' .36 




CAREER 


30.14 


27.31 


2.50 ' 


.0,1 


M9 




GOAL Vn-A. TOTAL 


62.41 


54.86 


lf.09 


,0001' 


" .30 





VISLART 

pERFIViART ' 
SCIENCE 
WRITING 
,GOALVnTOmL 

EFFSOLN 
i INEFJSOL 
EMOTAdj^ 
^GOALXTOTAb * 



12.98 
. 8.54 
11.14 

9;56 

42.19 

,30.19 
32.53 
H15 
76.87 



9.68 
6.95 
9.75 
9.04 
35.42 

27.59 
31.19 
14.59 
73.39 



2.78 
1.55 
1.15 
.50 
■>.77 

2.58 
1.24 
.50 
1.60 



Note •N.S.- Not statistic^^Jr significant at or above .05 probability level! 



.(^5 

N.X.fc/^; 

.oV 

N,& 
N.S. 
N.S. 



t 



.'22 
.12 / 
.09 V 
.04 

M 

.20 • 
.10 

.04 
.12 
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RELATED STUDIES 



The Division of Research and the Division of Educational Quiality Assessment have 
sponsored a variety of independent studies designed to me further insight into the validity of 
the grade 1 1 battery. The abstracts associated with these »udies are given on the foUowipg pages 
in goal number order. Complete data for these stupes are available upon request at the office 
of the Division of Research. All abstracts have been prepared by the researcher responsible for 
conducting each particular study. ^ 



WHICH STUDENT BEHAVldKS RELATE TO EQA GOAL IV TEST SCORES^ 
James R. Masters^.Gregory A. Shannon and Francis J. Reardon 

• .V * 

The purpose of this study was to obtain validity support based on student behavior, 
for the EQA Goal IV test in grade 11. The sample consisted of 2U grade 11 students from 
an urban, a suburban and a rural Pennsylvania school district. Three classrooms were selected 
from each district. The criteria, in eluded students' responses to multiple-choice measures of Goal' 
IV-oriented variables and assistant principals* ratings of students on discipline and truancy. Students- 
who scored in the upper and lower 27 per cent on the EQA test Were compared on the criterion 
ineasures. - . 

Validity support was found for ^e EQA Goal IV test based upon its relationship with 
the criterion measures in general. Student^ who earned high scores on the EQA test^tende^d to 
have higher grade averages, spent more rime studying outside schoot, experienced less difficulty 
pa/mg attention in class and spent fewer days being truant. They also tended to complete school 
assignments- on time, planned to advance further in school, belonged to clubs and felt that they 
and their friends were better accepted sqcially at school. 

Thus, both the overall relationship and the sepayate behavioral critenon measures provide 
evidence of validity in the Goal IV^^est for 11 th grade. 

GOAL V-GRADE 11 VALIDITY STl)DY: CITIZENSHIP 

Francis J. Reardon and Peg^^y L. Stank 

^ f A recently Completed study supports the validity of the EQA Goal V iqstniment for 
II th, grade. This study involyed 95 graderiT student? fruiii Twt) Pennsylv^ia school districts. 

TKeTwo sciijol districts were selected on the basis of past scores on a pteviously Validated 
, measure of citizenship; one district rated low on this measure, tHe other rated high. The Tame 
differences between these districts appeared in the EQA Goal V irfstrument scores. The average 
EQA Goal V score in* the high district was higher than the average EQA Goal V score in the 
low district. ' ' ' 

A self-report of good citizenship behaViors, as defined by the Quality Education Programs 
Study, was also adrtiinistered to the 11th grade students. Total scores on this instrument related 
significantly to total scores on the EQA Goal V instrument. The EQA Goal V high and low-scoring 
pupils also differed significantly on 12 of the student self-reported behaviors that indicated good 
citizenship. 
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• A central office rating of each student*s behavior was also obtained! This instrument 
measured such school-related behaviors as rate of truancy, cutting classes and discipline referrals. 
These Ifehaviojs were significantly related bath to student scores on the EQA Goal V instrument 
and to the^ student's self-report of good citizenship behaviors. 

The differences between the two contrasting school districts on the EQA Goal V 
instrument, tl^e relationship of both the student self-report and central office report of student 
good citizenship behaviors to their EQA Goal V scores and the differences 'telween EQA Goal 
V high- and low-scoring 1 1th grade students on a self-report of specific good c»penship tehaviors 
are all evidence that the EQA Goal V instrument is validly 'measuring a construct related to 
citizenship behaviors. . . ^ . » 

THE RELATIONSHIP BETWEEN THE EQ*A GOAL VII SCORES 
AND SELECTJED AREASf OF CREATIVE ATTrtUDE AND OUTPUT 

Gregory A. Shannon and James R. Masters^ \ ^ 

This study was designed to obtain validity support for the EQA Goal VII subtests and 
the total test when they are scored by either the norm-referenced or the criterion-referenced 
method. The sample consisted of a classroom ofTlth grade students from an urban and one 
classroom from a suburban Pennsylvania school district; there was a total of 70 students. 

The criterion measures included a^qife^tionnaire and a^semantic differential instrument. 
For each activity described in the Goal VII tp^t, the questionnaires asked, about the students' 
willingness to do the activily, how much th^ felt their .school would encourage them in it, 
the ^de level at which the student last.perfonjied the activity and the number of times each 
activity was performedjduring the previous two years. The second instrument asked the students 
to respond to adjective word-pairs in regard to how they felt" about working on visual arts, 
perfomaihg arts, wrijtin^ and science projects. This instrument yielded measures of how much 
the students?,would liFe to do the activities, how competent they felt about doing the actiyitiejs, 
and the extent td which they felt that their teacher would encourage them. 

Validity support was found for all of the EQA Goal VII tests when they were scored 
by either of two methods. Students who earned ,hi^ scores on the total test tended to have 
a positive attitude toward working on creative activities, feel confident in their ability to do 
creative activities and feel that they would receive both teacher and school encouragement. 
Students who earned high scores on the subtests tended to have a positive attitude toward doing 
these activities and fe^l that they would receive both teacher and> school encouragement, 'i^hey 
-also tended to have, performe^d such activities both frequently and in 10th or 11th grade. 

Thus, the studies in 1974 support^ the .validity of/ this test by showing . a positive 
relationship between EQA Godl VII test scores and self-reports ^f student behaviors and attitudes. 

/■ ^ 
. GOAL IX-GRADE 11 VALIDITY STUDY 

^ , Joyce S. fLim and Grace E, La^erty > 

• 

Goal IX was validated by. a correlational study with scores *from the EQA inventory, 
subscales cbmpared with choices made in the same content area on a survey of possible field 
trips and present^jons. ' ^ , ■ ' • 

The sample included 55 grade 11 -students from a school representing both suburban* 
and rural communities and various sogoeconomic levels. Students were ^s^gned to homerooms 
in strict alphabetical order. The 11th grade sample composed of tlM^e randomly selected* 
homerooms, was fairiy- representative of all Hth graders ift" the school. 



{ - ^ 

The stud1?nts completed the EQ A inventory and a survey of special events presented 
as possible field trips or special programs. They were asked, to select as many of the 17 events 
as the^ would be interested in attending. The analysis conipared thdr choices in each of ^ the 
nine content areas with their score on the inventory items representing that content area 

A similar study was done at grades 5, S and 11. Over all grades and content areas, 
representing 30'separate correlations, all coefficients were positive except one. The 11th grade 
analysis shpwed ill positive correlations, with correlations in all areas except world events, music 
and ecolo^ showing significance. In general, the evidence gathered by a comparison of 'actual 
choices of' students in .the survey of special events with their scores in the related area of the 
Goal IX inventory suggests that the instrument is measuring attitudes ^andvalues in these areas 
of human accjomplishment. * , * . 

DO EQA GOAL X SCORES AGREE WITH TEACHER RATINGS OF STUDENTS' 

ABILITY TO ADJUST TO CHANGE? 

James R. Masteis and Gregory A. Shannon ' 

A study of the instrument's validity was^conducted in a suburban school district where 
a large percentage of the student population had undergone change inutheir lives. Approximately 
60 grade 11 students who had experienced a great deal of change^termed the change group) 
and 60 grade 11 students whet had experienced little change (termed the non-change group) 
participated in the stud^. The change group }iad lived through such upsets as parental divorces, 
separation's or deaths, .or had experienced several residential movenients. Because they had lived 
through change, their "d'^^Orday beliaViors "would reflect How well they had been able to deal 
with it. Also, since situations described in the EQA instrument would^^be similar to those they 
had' experienced, their prediction^ of behavior should be more accurate than thos| of other students 
in their schools. * . , - . 

From the 1 20 students, teachers were asked^to choose students high an^ /ow in emotional 
fortitude, defined as tl\e abilities to (1) recover from a serious emotional setback, (2) confront 
difficult obstacfes and (3) discipline and direct onp's own behavior to achieve a goal. 

* For the change group, those rated high scored higher than those rated /ow on^the 
Effective Solutions subscale. For neither of the other two subscales nor for the total instrument 
were, differences found between highs and /ow. For the nori-change group no differences were 
found between highs m A lorn ^{ox any subscale .or for the total instrument. 

In the jstudy, then, support was Jound only for the validity of the Effective Solution^ 
subscale of the instrument. However, students had little difficulty placing themselves in the 
situations presented in the instrument and 89 per cent felt confident that their responses accurately 
reflected^ their actual behaviors. Therefore, it is possible that the limited amount of contact which 
teachers had with the students they rated caused some error in their ratings. 
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VAUDnV INFORMATION TROM FACTOR ANALYSIS 

rpactor analysis is a term used to* describe a set of statjftical prbcedures which- can 
be used to analyze the iatercorrelations. among a set of variables such as test 'scores. Factor analysis 
aids 'us in interpreting these relationships in terms of underlying /ac/orj and gives us insight into 
the amount of variation ih each separate EQAI instrument which is assqciated with each of the 
• hypoth^cal factors. In the general -sense, factor analysis pr^septi^ picture of how students respond 
to the %st battery in its entirety by showing how the>Mle slx^res within the battery cluster 
togetheg • ^ ' ^ 

% ' ' ' 

Factor analysis begiils with a correlation mateix of all the instrument scores contained • 
in the ^attery. For th^ purposes of this putdication,-^'the matrix presented in Table 5 is limited 
to the 29 subscales and the math and verbd^instruhients. AH subscale names are given in acronym 
form due to space limitations. This table has twrf X and Y columns per page: In ea<5h column 
set acronyms for two- subscales are given together with the correlation coefficient for that pair. . 
Correlations are based upon approximately 3,300 student records selected from the March .1974 
testing period which constitute a systematic sample\from the data tape containing about 48,000 
student^lre cords. , - > . 

& ^ * 

J A series of analyses* were performed on this correlational data which helped'identify 
. the un(teriying factor structure of the EQA Inventory. This structure may t« inferred bv examinirig 
the clusters of subsbales displaying correlations to a. give^ factor. Results of these analyses are 
presente^d in Table 5. / ' • 

- I This table lists Ae subsc^es in the left hand column. Tfte coeffidents: in the body 
' of thela^le are correlations between each subscale and the eight factors listed' horizontally near ^ 
the top|of the table. These correlations are called )&cror loadings, :ahd define the factor by showing 
how niuch each subscale is related to it, The hi^est loadings for each factor ane highlighted 
by a l^x^drajj^n around them. By looking to the subscale names associated with these loadings 
one cai? understand which . subscales describe the factor. ^ , . 

ONE: - RESPONSlBlLrfY FOR WELL-BEING OF SELF AND OTHERS 

The mqj or 'contributors to factor one are the citizenship (Goal V) and health (Goal 
VI) subscales. That these two goal %xe^ cluster is due in part te methods used to obtain scores. - . 
Both tests h^ve identical formats: persons are asked to p\it themselves into a hypothetical situation 
and dec^e whetl^er to fake ideal actions under a variety of motivation-including conditions, (ile,, 
peer , pressure, rejviratd,i^c.). Although the clustering of these subscales appears ' to be partially 
a product -of the tviy jof format used to elicit students' responses, a common variable also seems 
to be ^irrored by tnijs factor. 'Each -of the subscales in this cluster require that the students 
exhibitja sense of -personal responsibility for their own well-being^d the well-being of othei^ 
in . relation 'to heal tlv,.*^safety and social interactions. 

I The Goal" X subscales (effective and ineffective solutions 




tendency of students to exhibit socially acceptable behavior when f] 




change) which tap the 
strated also relate to this 



^ > 



* Extraction of principal components followed by varimak rotation-*See Hirmeri, H. H., Modern 
J »»/»/vc/c fTiii^flffft Press 19^0. • ' ' x r 

• 55 ^ • ' 
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'Factor Analysis, Chicago Press^l960. 
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FACTOR TWO: ATTITUDE TOWARD CREATIVE ENDEAVORS 

This factor is chiefly defined by the creative activities Subscales indicating that the Goal 
VII instrument tends to give information about students, whichf is relatively independent from 
that offered by the o,ther EQAI scales. The relatively high correlption of this factor to the Goal 
IX receiving subscale, shows that people who like to participate in science, art, writing and 
performing activities also like to observe others Who are recognized, as being. proficient in similar 
areas. . * ' ' - . 

FACTOR TttREE: BASIC COGNITIVE SKILLS ' , ' 

This factor is composed pf the three basic skills measures (math, verbal and vocational / 
knowledge) and the Goal IX subscales. The positive correlation between the (Joal I control pf 
environment' subscale and this factpr suggests that students who are more successful in school 
acl^gyenlent believe that they can influence; to 'a gre;ater extent,' their personal clestinjes'! 

FACTOR FOUR: . TOLERANCE TOWARD OTHERS , 

How comfortable students feel whea cohiing into contact with others differing in racial, 
religious, wealth, intellectual, or physical attributes forms the base of this fa9tt)r. This feeling 
state also has an action counterpart which is mirrored by ^he tendency to refrain from behaviors 
that might harm others. Evidence for this action component is shown by the significant positive 
rel^^onship between the Goal V citizenship subscale-conc^m fox welfare anfl dignity of others 
and this factor' The Goal IX valuing and receiving human accomplishments subscales also relate 
to this factor; demonstrating that the tendency to stereotype -others in a negative way is also 
related to the person's intolerance of others." X 

FACTOR FIVE: -^ELF-ESTEEM ^ ^ ' . v/' 

The subscale cluster comprising this faptor is -basically associated with the self-esteem 
instrument. In addition, a small relationship is also.f^und between this factor and th€ interest 
in school (Goal IV) subscale. This is understandable since many of the iteans in^ihe Goal I test 
attempt to assess self-esteem in the context of the classroom environment. Therefore, it is not 
surprising to find "Ihat some students who have a goo'd ^elf-concept in the' school setting also 
tend generally to have, pc5sitive feelings, about their school experiences^^.- 

FACTOR SlXr VALUIMG Ti^E EDUCATIONAL EXPERIENCE o 

Tliis factor is complex in that it is^defined by "arious subscales .acrossJour goal areas. 
Included in this factgr are the Goal I image in school settings. Goal IV attitude toward school, 
teachers - and leaming. Goal IX valuing and^receiving and Goaf X effective solution subs^es. 
All of these scales relate to attitudes and behaviors associated with classroom or schbol^related 
settings.. . . ' ' • ' . • 

It appears from the •way these subscales cluster that this factor mjght represent a belief 
that the classroom,, school and .general community are all fertile grounds to engage in learning 
experiences, ... ^ - ^ \/ ' 

JACTOR SEVEN:. EMOllON/X ^ADJUSTMENT TO CHANGE ' 

This' factor is defirred b> two subscales in the Goal X coping with change instrument. - 
The' length, of ^imc pecessary to adjust emotionally to frustration is seea to be Itrongly associated 
'with ffie tendency to refrain /rom aggressive or withdrawal reaction to frustrating events. A 



\ 



♦ • 

vicious circle 'might be reflected here in that people who get very upset in the face of change 
itiight b6 more willing to try negative solutions to their personal problems, leading to a new 
problem and, hence, a continuation of anxiety. ' r 

FACTOR ElbHT: CONFIDENCE IN- CONTROLLING PERSONAL AND VOCATIONAL 
FUTURE , 

This factor is defined by thfe vocational attitude subscales (work and career planning) 
and tlfe control of environment subscale in the self-esteem instrument. This cluster of v;ariabtes . 
suggests that vocational goal-setting is influenced by the individual's general confidence in his/her 
ability tb control day-to-day personal destiny. 
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TABLES 

GRADE 11 ••• 



<<197%>> 



I 



PAIR 



C0NTENV.7/ 


. 2r 


i 


GSELF 




.G0AL-3M 


11- 


6 


REL IG 


RELATE //*■ ; 
RELATE/A' , 


3- 


1. 


GSELF - 


n. so? 


G0AL-3M. 


11-. 


. .7 


SES 


3-. 


2i CONTENV 


ri. 388 


G0AL-3M 


11- 


3 


INTELL 


SCHLtH'fG;. 


I- 


1 


Q'SE LF 


' 'n. 5o«i 


'60AL-3M 


11- 


9 


HANOGP 


SCffLI«AG- 
SCHLT^yAG 


«»-- 


2 


?ONtENy 


n.«»57 


G0AL-3M 


11- 


10 GCAL-3V 






ticlate' 


n.«»32 


LEARN 


12- 


1 


G ';E LF 




I 


'G<T LF 


;h. 0Z8 


LEARN 


12- 




C ONTENV 


..RACCCr ' 


5- 




C ONTENV ' 


' n. 107 


LEARN' 


12- 


y 


RELATE 


,;RACLrp ' 






RFL.ATr 


n. lus 


LEARN 


12- 




SClfLIHAO 




•i- 




S CH L I MA'G 


n. 127 


.LEARN 


12- 


5 


R AC EG 2 


• RCLIG 


• .G- 


I 


G r>E LF 


n.083 


LEARN 


12- 


6 


RELIG 


/ /rcl'/p ' • 




2 


C ONTENV 


178 


LEARN 


12- 


7 


SES 






3 


RELATE , 
JSCHLIMAG ^- 


. n.i«»s 


sLEARN 


12- 


8 


INTELL 


RE-LIC- \ ' 


G- 


(» 


n. 198 


LEARN 


12- 


9 


H ANOtP 




G- 


5 


R AC EG 2 


n.*»S2 


LEAR^ 


t2- 


10 


G OA L- 3V 




T>- 


1 


GSELF 


n. 13S 


LEARr^ 


. 12- 


11 


G OA L- 3M • 




7- 


•> 


C ONTENV 


0. 23S 


SCHOOL 


13- 


• 1 


CSELF 


7- 


.3 


RFLATE 


n.i8«» 


SCHOOL 


_ 13- 


2 


C ONTENV 




•7- 


SCHLIMAG 


n. 157 


SCHOOL 


,13- 


. 3 


RELATE 


7- 


5 


R AC EX 2 


n. 539 


SCHOOL 


13- 


<« 


SCHLIMAG 




7- 


C 


rtlig' 


n. 45G . 


SCHOOL 


13- 


5 


R AC EG 2 » 


INJf.lL 


?- 


1 


GSE 


'n.335 


SCHOOL 


13-, 




RELIG 




8- 


*> 

C 


CONTfeNV 


n. 18 8 


SCHOOL 


13- 


7 


SES 


INirtjL 


8- 


3 


RELATE 


n.09i 


SCHOOL 


13- 


8 


INTELL 


IN'TEILL 


3- 


«♦ 


SCHLIMAG 


n.'d9 5 


SCHOOL 


13- 


9 


H ANDCP 


INTf.Ll 


8- 


5 


RACEG2 


n.43i 


SCHOOL 


._2.13-. 


:S 


G OA L- 3V 


INTFLL 


8- 


£ 


RELIG 


n. 322 


SCHOOL 


13- 




GCAL-3M 


iNTf LL 


8- 


7 


S.FS 


n. 523 


SCHOOL 


13- 


12 


LEARN 


• HANDCP 


9- 


1 


GSE EF 


n. 089 


TEACHER 


1«»- 


1 


GSELF 


HA'?*C CP 


Q- 


2 


C ONTENV * 


n.252 


TEACHER 


1«»- 


2 


C ONTENV 




Q — 


3 


RELATE 


n.ms 


TEACHER 


1^ 14- 


3 


RELATE 


HAf.CCP • 


9- 


(» 


SCHLIMAG- 


n-.i37 


TEACHER 




1 


•S CHLIMAG 


HANLCP 




5 


R AC TG 2 


n. «»9i 


-TEACHER 




; 5 'R AC EG 2 


HANCC?!, 




6 


RELIG 


" t^.v3'»9 '• 


TEACHER 


1«»- 


- R 


RELIG 


HAND CP 


9- 


7. 


srs 


• n. 539 


TEACHER 


• 1«»- 


7 


SES 




o _ 


8 


INTELL-- 


n.59 7 


TEACHER 


1«»- 


« 8 


INTELL 


'GOALrTV. 




1 


G £E LF . 


n. 068 


TEACHER 


1«»- 


9' 


HANDCr 


GOAL-TV 


IC- 


2 


C ONTENV' 


n.215 


TEACHER. 




.10 


G OA L- 3V 


.GOAL -.TV 


10- 


3 


RELATE « 


• n,os3 


TEACHER 


14- 


11 


G0AL-3M 


'G'OAL-]' V 


ir- 


«♦ 


SCHLIMAG 


n.29*» ' 


TEACHER 




12 


LEARN 


G0AL-3V. 


10- 


J 5 


R AC EG 2 


. n. i«»9 - 


TEACHER 


14- 


13 


SCHOOL 


60AL-'V. 


10- 


6 


RELIG 


' . n.229 


;WELFDIG 


IS- 


1 


GSELF 


COAL-TV 


in- 


7 


srs 


■n.082 


WCLFDIO 


15- 


2 


CONIENV 


C'OAL-.I> • 


10- 


8 


INTELL _ 


n.oii 


^WELFDlb 


_ 15- 


3 


RELATE 


GOAL -TV 


in- 


. 9 


HANOCP 


n.o*75 . 


WELFO.IG 


15- 


«l 


SCHLIMAG 


. 60AL-3K 


ll-r 


1 


GSELF 


0.086 " 


UCLFDIC^ 


> 15- 


5 


RACE02 


6C.AL*?m'- 


11- 


2 


CCNTENV 


0.191 


UELFDIG 


" IS- 


S 


RELIG 


GOAL-TIS 


11- 


3 


RELATE 


0.068 


WELFQIO 


IS- 


7 


SES 


' COAbr^M 


11- 




SCHLIHAO 


0. 292 


HELFOIO 


15- 


"8 


INTELL • 




n- 


"5 


RACEC.2_,,.. 


.....D.099 . 


JIELFPXO 




9 


HANOCP 



ERIC 



R 



... % 




n.057 

n.o««2 

n.039 

n. 1C7 
r. 12 8 

1. IZs? 

n. 13^^ 
,n. 37fe 

0. 207. 

n.23i 
n. m 9 
n. «»53 

'7.13 7 
n.099 

n. 10 8 
n. 131, 
n.mi 

n.;203 

n. 184 

n.372 
0.65i 
O.Oj 
■0.2f99 

n. 381 

0. 205 
0.355 
0.235 
0.323 
0.3*5 
0.365 
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TABLE 'S (continued) 
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PAIR 






R 




PAIR 


\ 


t f 


R 


> X 






Y 

>, 




X 




^ ^* 
•\ 

\\ 

K 


Y 


• 


WELFPIG 


15- 


in. 


G OA L- 1V 


• ' n« 11 9 


PHEALTH 


• 

IS** 


is* WELFDIG 


0.273 


VELFPTC 


15- 


11 


GOA L-3M 


PHCALTH 


18^' 


lb 


L AW AU TH 


0.384 


weLfdig 


15- 


12 


LfARN 




PHEALTM 


18-. 


17 




0.2G0 


WELFDTG ^ 


15- 


13 


SCHOOL 


0« 215 


SAFETY 


19- 


1 




0. 137 


MELFOIG ' 


15- 


lU 


TEACHER 


n«23e 


SAFETY 


19- 




C ON TF NV 


0. 320 


LAWAUTH 


16- 


1 


GSr LF 


- n#iG7 


SAFETY 


19L-; 


•J 


Rn ATF 


«0. 08 3 


LAWAUTH 


IG- 


2 


CONTENV 


n#33G 


SAFE.TY 


• 19-< 


u 


fM 1 f MA 

vn " 


0. 190 


LAWAUTH 


. IG- 


3 


RELATE 


o#om 

< 


SAFETY__ 


.'19-, 






♦3. 150 


LAWAUTH 


IG- 


<< 

0 


SCHLIMAG 


a. 254 


SAFETY 


19- 


c 


RFLlfj 


n. 127 


LAWAUTH 


16- 


5 


RACEG2 


0,206 


SAFETY . 


. . 19- 


7 


I- <^ 


n. 16 s 


LAWAUTH 


IG- 


6 


RELIG / 


\ 0,129' 


SAFETY 


19' 


fl 

0 


T NT n I 


• 0.176 


LAWA^H 


16- 


7 


SES A 


. \ 0.20$ 


SAFETY 


19- 


Q 




* 0.224 


LAWAUTH 


16- 


8 


intecl/ 


\0. 261 


SAFETY 


19- 


10 


G OA 3V 


0.172 


LAWAUTH 
LAWAUTH 


16- 


.9 


HANDC^ . 


._)□. 265 


„ SAFETY 


_ 19- 


« AX 


G OA 3M 


0.123 


16- 


IC 


GOA L- 3V 


n. 159 


SAFETY^ 


19- 


12 


LTA RN 


0.330 


LAWAUTH 


16- 


11 


G0AL-3H 


0,119 


safetI^ 


19- 


13 


SCH OOL 


• > 0.205 


LAWAUTH 


16- 


12 


LEARN 


o;37«i . 


' safety 






TrA€H PR 


0. 190 


LAWAUTH 


16- 


13 


SCHOOL 


0.316 


SAFETY 


19- 


15 


WELFDIG 


0.436 


. LAWAUT'H 


16- 


iV TEACHER 


0. 303 


SAFETY 


19- 


IS 


L AW AD'TH 


0.5GG 


LAWAUTH 


16- 


15 


WELFDIG 


^. 0.627 


SAFETY. 


19- 


17 


RESPINTG 


n.332 


RESPINTG 


17- 


' 1 


GSELF , 


f 0.073. 


SAFETY, 


19- 


18 


PHE AtrTH 


0.427 


RcSPTHTG^ 


17- 


2 


CONTENy 


0. 300 


' DRUGS 


20- 


• 1 


Gsr LF 


0. 152 


. PESPINTG 


17- 


3 


RELATE 


0.086* 


DRUGS 


20- 


7 


C ONTF NV 


0.318 


RESR^TNTG 


17- 


4 


SCHLIHAG 


0.249; 


DR^GS 


20- 


«^ 


Rn ATT 


O.OSl 


RESPItlTG 


-17- 


5 


RACEG2 


0.259* 


DRUGS 


20- 


n 


c ru t T MA Q 


. 0.224 


RESP^NTG^'jlT- 
REGPINTG--' 17- 


G 


RELIG 


0.215 


DRUGS 


2C' 


e 

D 




_ 0.111 


7 


SES 


\ 0.257 


' DRUGS 


20- 


c 

0 




0.053 


RE5PINTG 




8 


INTELL 


^ 0.289 


DRUGS _ 


20- 


f 


c rc 


■ 0.137 


, RESPINTG 


17- 


9 


H4(nDCP' 


0.308 


. DRUGS . 


20- 


0 

0 


'T NT Fl I L 


0.188 


RESPINTG 


17- 


ICU 


(TtA Lr 3V 


, 0.199 ( 
/ 0. i5«uJ 


DRUGS , 


■20r 


3 




' 0.131 


.'RESPINTG 


17- 


11 


G OA L- 3M 


DRUGS 


20- 




19 vA OV 


0.149 


RESPINTG 
RESPINTG 


17- 
17- 


12 
13 


LEAWi . 
SCHiOOL 


.. 0.337' 
0. 2«0L 
0.?54^^ 


DRUGS 
DRUGS 


20- 
20- 


fz 


HA t ^ 7M ^ 

LEiRN - ■ 


0. 155 
0.339 


. RESPINTG 


17- 


1*» 


TEACHER 


J)RU6S'^-. 


20- 


13: 


SCHOOL 


0.296 


RESPINTG 


17- 


15 


WELFDIG 


0.617 


IbRUGS 


r 20- 


IH 


TEA CHER 


0.250 


RESPINTG 


17- 


IG 


LAWAUTH 


0.630 


DRUGS 


20- 


15 


MELFOIG 


^ 0.413 


. , PHCA4.TH. 


18^ 


1 


GSELF / ' 


0. 143 


DRUGS 


20- 


16 


LAWAUTH 


0.571 


PHtALTH 


.18- 


2 


CONTENV 


0.210 


DRUGS 


20-' 


17 


RESPINTG. 


Jp.435 


PHcALTH 


18- 


3 


RELATE- 


- n«046. 


DRUGS 


2Q^ 


18 


PHEALTH 


0.. 37 5 


PHTALTiSj 


18- 


<» 


SCHLIMAG 


0. 141 


DRUGS 


20- 


19 


SAFETY 


-' 0.551 


PHCALTH 


18- 


5 


RAC^62 ' 


V 0.051 




21- 


1 


GSELF 


.0.09G 


PHCALTH 


18- 


G 


RELIG -. 


0.009 


VISLART 


21- 


2 


CONTENV 


0.012 


PHCALTH 


18- 


7 


srs 


.'■ .. n.048 


VISLART 


21- 


.3 


RrLATr> 


0. 136 


PHCALTH 


18- 


8 


INTELL^ .' 


**** ^ _ ^ 

%L.,' 0.083 


VISLAI^T 


21- 


4 


SCHLIMAG 


... 6.'21 5 


PHCALTM 


18- 


9 


HANOCP 


•':£: 0.103 


.VISLART 


21- 


S> RACEQ2 


0. 158 


• PHCALTH. 


18- 


10 


GOALrSV 




VISLART 


21- 


6 


RELIG 


0^140 


PHtALTH 


18- 


11 


GOAL'SN 




VISLART 


21- 


7 


SCS 


0.106 


PHCALTH 


18r 


IZ LFARN . 


0.247, 


^ WSLART 


21- 


8 


JNTCLL 


■ 0.135 


, f M'CALTM 




13 


SCHQOL 


0. 138 


VISLART 


21- 


'•■ 9 


Nanocp 


0. 159 


FHCAkTM 


la- 


TCACHCR 


0.135 




.: 21r 


10?' C0Ai.-3V .. - 


0.078 



TABLE 5 (conlinued) 



I" 



;lNDlVTOU/lL,%TtlDrNT DATA -GRAOP 11 



<<l«37^v> > 



PAfR 



PAIR 



X 


f 




Y 




X 


- 


— 


Y 




VISLART 


21- 


11 


G OA L- 3rt 


n. 013 


SCIENCE 


23- 


23 


DRUGS. 


• •• 

n. 04 0 


■ *. .VISLA<>T 


21- 


ir 


LEARN , 


n.''22B 


SCIENCE 


23- 


21 


VISLART 


0.65l" 


VISLA=7T 


21-- 


13 


SCHOOL 


n. 351 . 


SCIENCE 


23-^ 


22 


PE.RFMART 


4»-0. 64 3 


VrSLA'?T 


21- 


U 


TrACHTR 


. n. 037 


WRITING 


?«♦- 


•1 


GSELF , 


.' • 0.061 


VISL.«'?T 


"21- 


15 


WFLFOIG 


n. 168 


WRITINC 


r«»- 


2 


COMTEMV. ... 


-n.oie- 




21 - 


IG 


L AWAUTH 


n. 085 


WRITING 


24- 


T 


RELATE 


n.02 3 . 


VlSLAHT 


21- 


It 


RFSPINTG 


n. 03 3 


WRITtNG 


24- 


4 


schl'imag 


n.ioi 


VISLAPT 


21- 


le' 


PVr ALTH 


.0. oil 


WRITING, 


24-. 


5 


R AC EC 2 


T). G21 


VISLA'^ T 


21- 


in 


S AF E T Y 


n. Q^B 


WRITING 


24- 


6 


rflig 


n. oj"". 


, VI SLA" I 




2CV0RUGS • 


03 G 


WRITING 


24- 


7. 


srs 


n. ouo 




— 


1 


G ^,F tF 


n. 066 


WRITING 


24- 


8 


INTELL ' 


a.DSft 


• PLKr^AM 








n. 025 


WRITING 


24- 


9 


HANOCP - 


0.02 6 




22- 


T 


pri kjr 


n. 12 p. 


WRITING. 


24- 


10 


GOAL- 'V 


-n.D07 










n. lis 


WRITING 


24- 


11 


6 OA L-2M 


-n.oon 


pjjct "APT 


22- 


c 


p Ap r n 7 


n. 093 


WRITING 


24- 


12 


LFARN 


Oi 107-':^ 


' ■ 'PERF-'ART 




c 

D 


RFL TG 


n. 036 


WAITING* 


24- 


13 


SCHOOL 


n.0Q5 


PERF««ART 


22- 


7 




n.059 


WRITING 


'24- 


14 


TCA.CHER 


n.038 


CE-FMara 


^ — . 




T NT r L I * 


n^..096 


-WRITING 


24- 


15 


WELFOTG 


-n. ooi 


PE^^F MART 


22- 


g 


H ANQ'CP 

• • nil U w 1 


08 5 


WRITING 


24- 


16 


L AWAUJH 


-n»030 


PERFMAKT 


22- 


10 


6 CA L-3V 


-n.p«i5 


^WRITING 


24- 


17 


•RESPINTG 


-0.027 


PEjRFMART 


22- 




G CA L- 3M 


-(5.076 


WRITING 


24- 


18 'P>€ ALTH 


0.C14 


PERF,Ml^RT 


22- 


12 


LFARN 


..n. 119 - 


- WRITING - 


24- 


19 


SAFETY 


-0. 045 




22- 


13 


SCHOOL 


n. 023 


^WRITING 


,24- 


20 


DRUGS 


-n.U39 


PERf'mi^rT- 


■ 22- 


.14 


TEACflER 


n. Qtii./' 


WRITING 


'24- 


21 


VISLART 


0. 535- 


PC%"^RT 


22- 


15 


WFLFOIG 


n. 091/ 


N WRITING 


24- 


22 


PFRFMART 


n. 518 


PbpF-'^ART 




15 


L AWAUTH . 


. n. oil ' 


>RITIN6 


^24- 


23 


SCIENCE 


n. 628 


PEcrvftRT 


22- 


17 


RESPINTG 


n. 03i . 


WORKATD 


25- 


1 


GSELF 




-F£RFM/\RT 


22- 


IS- 


P HE ALTH 


-n. oia 


WORK AT D 


25- 


2 


CONTE NV 


0. 439 


PEPF'^flrr 


^ <- 


IS 


"SAFETY 


-0. Oltll 


WORKATO 


25- 


3 


RELATE- 


• 0.156 


P£'«^"AFT 


• 22- 


20 


DRUGS . . 


n. 00 8 \ 


WORKATD 


?5- 


• 4 


SCHLIMAG 


0*27?- 


PEPFMART 


22- 


21 


'VISLART' 


n.68 5 \ 


WORKATD 


25- 


5 


R AC ? 


n.2i8- 


SCIENCE 


23- 


1- 


• OSELF , ..: . 


0. 06 8 ^ 


y WpRKATD 


>25- 


6 


RFLIG 


n.i7x • 


SCIE'JCL 


I 3- 


2 


CONTENV , 


n. 046 


\W0RKATP 


25-\ 7 


SES 


' 0.-2i6 


, .s.c.;^>/c t 


23- 


3 


RfLATE 


n..059 


IkORKATD 


25-N8 


INPELL . 


0.223 


SCIENCT 


23- 


t 


SCHLIHAG 


n,ii2 


WORKATD 


25- 


9 


HANDCP 


n.274- 


• " SCxCNCE 


•2 3- 


5 


RACrG2 


n. 115 * 


wdRK^ATD 


25- 


10,-G0AL-3V* . 


n. 222-- 


sciV'pf 


23- 


B. 


'RFL IG 


0.^08 5 • 


w6rkatd ■ 


25- 


iT 


G CA L- 3H . 


n. 188 


SCIEVCE 


23- 


7 


SES 


0. 080 


WORKATD 


25- 


12 


LEARN 


0.419 


■SCI£t;CE 


23- 


8 


INTFLL 


n. 12-6 


WORKATD 


'25- 


13 


SCHOOL 


.0.289 . 


SCT.ENPE 


23)-' 


9 


>4AN0CP 


n. 120- 


/wORKATD 1 


25- 


14 


TFACHER ' 


. . n.'27 2 ' 


: SCIENCE 


2 3- 


IC 


GOAL-IV 


-0. 003 


/ WORKATD- « 


2S- 


15 


W'ELFOIG 


0. 399 


■SCIENCE 


23 - 


ii 


GCAL-3M 


-n. 067 


/ WORKATD 


25- 


16 


LAW AUTH 


n. ^^ 8 


• SCJE'.'CE 


^ • 




LFARN*^ 


n. 158 


' WORKATD'' 


25- 


17 


RFSFINTG 




ISCIEKCE ♦ 


23r. 


.13 


SCHOOL 


•h. 03 0 


\ WORKATD 


25- 


18 


PWALTH 


n;25i 


ISCIEMCt 




i«» 


TFACHER 


n. 050 


] WorkTtd 


25- 


19 


SAFETY 


n.37 8 


isc ItNCr' 


23- 


15y.WELF0I6 


n. 130 


J WORKATD 


25- 


20 


DRUGS 


n.4i6 




23- 


IB 


LAW AUTH 


■ n. 070^ 


WORKATD 


25- 


21 


VISLART 


n. 094 


^ ..SCIENCE 




17 


RESPINTQ 


0.075 


WORKATD 


25- 


22 


perfKart 


. nVC23- 


SCIENCE 




18 


PfCALTH 


0. oiq 


WORKATD 


25- 


23 


SCr.ENCE 


..n. 0S2 


f SCUNCC 




19 


SAFEtt 


_ 0.0%0 


.WORKATD .. 


25- 


2* 


WRITING 


0.D03 



ERIC 



60 



66 



J 



Mm 



iNoiyrfStijMr 5Tuo^"N 



TABLE 5 (continued) 



T DATA P'^AOt 11 <<197i|>> 

. I • ' - 

. R PAir 



•PLANTNC 
PLANING. 
PLANING 
PLANIMC 
PLANING 

■ PLANTNC 
PLANING 
PLANING 
PLANING 
PLANJN-'p-" 
PLAK^'tiirG 
PLANING 
PLANING 
PLANING 
PLANING 
ej.ANI?4G 
ffjANINC 
PLANING 
PLANING 
PLANING 
PL AN IMG 
PLANING 
PLANING 
PLANING 
PLANING 
GOAL. 




26- 

26- 
CG- 
26: 
26- 
26- 
26- 
26- 

26- 
'26- 
2E' 
26- 
2G- 
26- 
26- 
26- 
26- 
26- 
26- 
26- 
26- 
26- 
26,- 
26- 
27- 
27- 
27- 
27- 
27- 
27- 
27- 
27- 
27- 
27- 
27- 
2X- 
27- 
27- 



-FRir 



1 GSeLF 

2 CONTENV . 
.3.RFUATE 

i| SCHLIMA6 
5 RACEG2 
G ftrL^G 

7 srs 

3 I»*TELL ■ 
• -.9 HANDCP 
'■ir-'-GML-3V. : 

11 6'€iL-ZH 

12 LCARN 

13 SCHOOL 
m TEACHER 
15 WELFOIC- 

15 LAUAUTH ' 

17 RESPINTG 

18 :P HEALTH 

19 SAFETY 

20 DRUGS 

21 VISLART 

22 PERfMART, . 

23 SCIENCE . 
2«»; WRITING 

*25 WORKATO 

1 GSELF __ 

2 GONTENV 

3 RELATE 

<l SCHLIHAG 
5 R AC EG 2 
G RfLIG ' ' 

7 SES ^ * 

8 I NT ELL 

9 HANDGP 

10 G0AL-3V 

11 GCAL-3M 

12 LEARN 

13 SCHOOL 
I* TfACHFR 
.15 WELFOIG 

16 LAUAUTH 
.17 RFSPINTG 

18 PHTALTH 

10 SAFETY __ 

20 DRUGS / 

21 VISLARt 

22 PERFHART - 

23 SCICNCe 
2« VRXTtNO. 
25*llCRKAtO _ 

'/ 

'/ 

il ■ 



n.27G G0AL-8K 

n.«»00 VALUING 

n. 13G VALUING 

n.271 VALUING 

n,W5 VALUINC 

n«.120 VALUING^ 

,n«119 . VALUING 

:n.l27 VALUING. 

; 0.156 VALUING 

n«15«l VALUING 

n. 150 / VALUING 

0.266 .VALUING 

0.233 . VALUING 

0.185 . VALUING.. 

0.190 . ' VALUING 

0.251/ * VALUING 

0.211- VALUING 

" 0.172 VALUING 

0.223. VALUING 

0.25-0- VALUING 

10.037 _>*tttTITG- 
0. 02^~"^'VAt 
0. 062 



0. 033 
0. 5t»5 
0. 061 
0.242 
0. 068 
0. 260 
0. 1«»2 
R. 197 
0. 69 <l 
n.C28 
0. 106 
0. 680 
0. 594 
- 0.263 
n. Ill 
n. 172 
0. 15(| 
0. 189 
0. 222 
b« 046 
_ 0.285- 
* 0A87 
0. 032 
«0. G6G 
-0. 032 
-0. 078 
0.2% 8 



VALUING 
VALUING ' 
VALUING 
VALUING 
VALUING,: 
VALUING 
VALUING 

receivng 
re"ceivng 
receivng 
receivng 
receivng 
receivng 
receivng 
receivng 
receivng 
receivng 
receivng 
rece-iyng 

RtCEIVNG 
RECEIVNG 
RCCCIVNO 
RECEIVNG 
RECEIVNG 
RECEIVNG 
RCCCIVNO 



. 27- 2G PLANING 

2fe- I GSELP 

28- 2 CONTENV 

28- 3 RELATE 

28-r H SCHLIHAG 

28- 5 RACE62 

28- B RELIG 

„i28- 7 SES 

28- 8 INTELL 

.28-, 9 HANDCP < 

28- 10' G0AL-3V 

. . 28- 11 G0AL-3M 

,28- 12 LEARN * 

. 28- 13 SCHOOL 

28-' m TEACHER 

• 28- 15 WELFOIG, 

28 T 16 LAWAUTH , 

28- 17 RESPINTG 

28- 18 PHEALTH 

_28- 19 SAFETY 

7 28-' 20 DRUGS 
^28- 2t^=JUSLART 

. ^8- 22 PERFHART 

2»- 23 SCIENCE 

28 r 2H WRITING 



0.18^ 



2 
3 



_28- 2S 
28- 2G 

28- 27 

29- 1 
29- 
29- 
29- 
29- 
29- 
29- 
59-. 

29-r 

29- 
29- 
29- 



WORKATO 
PLANING 
60A'L-6K - 
GSETLF 
CONTE^NV 

R£;late" 
schlihag 

,5 RAG EG 2 

6 RELIG 

7 SES 

8 INTELL 

9 HANDCP ■ 

10 GCAL-3V 

11 G0AL-3H 

12 LEARN 
29- 13 SCHOOL. 
29- 1<» TEACHER 
29» is WELFOTO 
29- IG LAUAUTH 
29- 17 RFSPINTG 
29- 18 PHEALTH 
23- 19 SATETY 



RECEIVHO-JTZ^- 23 DRUGS 
RCCCIVNO "29« 21 VISLART 
lie CE IVNG 29.T . at^ERf HAR T 



0.167 
0.372 
0.215 
n. 312 
0.261 
0.266 
. 0.245 
0.219 
. 0.266 
% 0.389 

ni33G \». 
0.396 « 
. 0.308 > 
0. 333 
0.349 
0.3.48 
•3*:380 
0.179 . 
0.336 
\-0.27S . 
.0. 115 

'o;oo7 

■^0^062 
-n.,019, * 

0.390 

0.220 

0.389, 

' n*.:^26 

0.29G* 
0.147 
n. 345 
0.266 
0.267 
• 0.243 

0,;272 -. • 
0.309 
0.29 5 
0.214 
0.4S5 ^ 
0.246 
a. 274 , 

rr.387 

^'. 33 7 ' . 
9.35? 
■ 0. 168 
0".265 
n.2S6 
0.3C7 
" 0.206 ♦ 



- < TABLE 5 

INDIVIDUAL S.TUDCNT DATA • 

I 

/ PAIR^' • R 



hL CL . V N o 


O » 




S CI ENCt 


^ '0»25fl 


kC Ct T VNG 


r? - 




Wni TING 


n. 187 


RL CE I V .G 






WOQKATO 


. n. 3«n 


RlClTVNG 




2G 


PLANING 


0. 181 


RE ct ^ vr.G 




27 


GpAL-BK 


0.282 


RE Ct IVNG 


23- 


28 


V&LUING 


0. 557, 


trrsoLN 


30- 


1 


gself' 




LP rSOLN 


3C- 




CONTENV 


n. 321 


LFFSCLN 


3C- 


3 


RELATE 


; n. 121 


EFFSOLN 


3n- 


«♦ 


SCHLIMAG 


0.250 


EFFSCLN 




5 


R AC EG 2 


0-. 155 


EFFSOLN 




6 


relig 


0. 090 


EFFSOLN 


z^- 


7 


srs 


. ^. 155 


LFFSCL N 


30- 


8 


INTELL 


- ..J-; 0. 215 


EFFSCLN 


3D-;. 


9 


HANDCP . 


n. 23 8 


EFF 50LN 


30- 


■■10 


• G OA L-: 3V 


n. 089 


EFFSCLN 




11 


GCA L-3M 


0. 067 


EFFSCLN 


.3C- 


i; 


LEARN ■ 


0. 10-8 


EFFSOLN 


- 3C- 


13 


SCHOOL 


0. 337 


EF»"StLt; 




1\ TXACHER . 


0. 28(» 


E.FFSrL'.' 


3C- 


15 ^ELFDIG 


0. 31G 


EFFSCLN' 


' 3C- 


IS 


LAWAUTH 


0.377 


EFFSCLN 


7 n ^ 

- tj 


17 


respintg 


0. 30 7 


EFF'SCLN ' 




18 


.PHSIALTH 


0.32G 


EF FSO^LN 


2C- 


19 


SAFETY 


n.'293 


EFFSOLN 


zt- 


20 


DRUGS 


_ .. 0.325 


EFFSCLN 


rc- 


21 


VISLARt 


o.ii,n 


EFFSCLN 


30- 


22 


PERFMARTs 


n. 052 


EFFSCLN 


3C- 


~2.I 


SCIENCE • 


. 0.083 


EFFSCLN 


30- 


2^•'a^RITING•.-■ 


0.0D1 


EFF-'LN 


30— 


25 


WORKATD ■ 


0.368 


EFfcrLN 


3C- 


2G 


PLANING 


6.225 


EFFSCLN 


30- 


27 


GOA L-PK 


0. 12 9 


EFP<-'^LN 


3C-' 


23- 


.VALUING 


0.^326 


EFFSCLN . 


?Q- 


23. 


RfCEIVNG 


0.3^3 5 


INEf rsCL 


. 31- 


1 


6 se: Lf 


. -n..2i.2 


INEFF7.0L. 


31- 


2 


CONTENV • 


0.381 


INEFFSOL 


^l- 


3 


RELATE 


" "p.l59 


INEFTSOL 


31- 


1 


SCHLIMAG 


, ni2,a'» 


lNErF';CL 


31- 


5 


RAG to 2 


Oi 18 7 


INEF«-SCL 


31- 


6 


RELIG 


0.152 


IN^FFSOL 


31- 


< 7 


SES 


■ 0.23 5^ 


iNtPrsOL 


31- 


9 


XNTELL 




INEFFSCL 


31- 


9 HANDCP 


0.229 


INEFFSOL • 


31- 


10 


G0AL-3V 




INEFFSCL 


31- 


11 


6CAL-3H . 


Q.iis 


JNLFFSOL 


31- 


12 


LfARN 




IHEFFSOL 

1 ■ . 


31- 


13. 


SCHOOL 


0*300 

-1 



ERIC 



(continued) 



♦ ♦ GRADE 11 <<in7M>> 
I 





PAIR 






n 


Y 

A 

t 






' Y 

1 


• 


1 

xnwr r 


J 1 — 


IH 


1 A CH t K 


fJ. 29 » 




71 — 
OX 




u r 1 r n Tn 
H LL r U i. i> 


n* oo 7 


INur r ^ UL 


31 — 


lb 


L AW AUTIi 


0. 119^ 


INlFFSOL 


31- 




RFSPINTG 


0. 101' 


INEFFSOL 


31- 


laf 


PHf ALTH 


0. 2'J9 


INEFFSOL 


31-- 


19 


SAFETY 


0.331 . 


INEFFSOL 


31,- 


20 


DRUGS 


0. 12C " 


INEFFSOL 


31- 


21 


VISLART 


0. 063 


INEFFSOL 




22 


PERFMART 


0.039 


.INEFFS0L. 


31- 


23 


SCIENCE 


0. C51 


'INEFFSOL 


31- 


21 


WRITING • 


-0. 001 


.INEFFSOl 


.31- 


25 


HCRKATD 


0. 136 


.INEFFSOL 


31- 


2G 


PLANING 


C. 271 


.INEFFSOL . 


31- 


•27 


60AL-8K 


0. 131 


INEFFSOL 


31- 


2S 


VALUING - 


0. 338 


INEFFSOL-^ 


31- 


29 


RtCEIVNG 


0.276 


INEFFSOL 


31- 


30 


EFFSOLN 


0. 392 


EHOTADJ 


32-. 


1 


GSE LF 


n. 153 


>EMOTAD J 


32- 


2 


CONTENV 


0.080 


. EMOtADj/ 


32- 


.3 


RELATE 


0.07!; 


EMOTADJ 


32- 


«» 


SCHLIMAG 


0.C81 


^ EHOTADJ _ 


32-_ 


5 


R AC EG 2 


C-.QGl 


EHOTADJ 


'32- 


G 


RELIG - 


0. C7 5 


EHOTADJ . 


. 32- 


7 


SES 


0. 07-9 


EHCT AD J 


32- 


8 


INTELL . 


0.058 ' 


EHOTADJ 


.32- 


9 


HANDCP 


n.ci7 ■ 


EHOTADJ - 


32- 


10 


GOA L-3V. 


b. cci 


. EHOTADJ 


-32 -_ 


11 


GCAL-3M _ 


. 0.013 


EHOTADJ 


32- 


12 


LEARN 


0.052 


EHOJ>AD J 


32- 


-13 


iSCHOOL 


30.017 


EMOTAD J 


32- 


11 


TEA CHER 


1.055 


•^EHOTADJ 


32- 


15 


HELFDIG 


n. 05 3 


EHO.TAD J 


32- 


16 


LAWAUTH • 


- ?!. 073 


EHOTADJ 


32- 


17 


RESPINTG 


Q. 051 


EMOTAD'J 


32- 


18 


PHE ALTH 


n. 109 ' 


EHOTADJ ^ 


32- 


19 


"SAFETY 


C. 017 


"EHOTADJ . 


32- 


2b 


DRUGS 


n. 1C5 


EHOTADJ • 


32- 


21 


VISLART 


-0. 03 5 


EHOTADJ' 


32- 


22 


PERFHART 


n. C17 


^.EMCTT-AD.J _ 


32- 


23 


SCIENCE 


-n. 00 5 , 


^EHOt-ADJ 


32- 


21 


WRITING 


0.037 • 


EHOTADJ, 


32- 


25 


HCRKATD 


0.05 7 -. 


C HOT AO J • 


.32- 


2S 


PLANING 


n. OR? 


tMOTADJ 


32- 


27 


GOA L-SK 


-0.019 


•EHbTADJ 


32- 


28. 


VALUING 




;^W8TADJ 


32- 


29 


RECEIVNG 


,^"^^019 


e^OTAOJ- 


32- 


30 


EFFSOLN 


-0.050 


EHOTADJ 


32- 


31 


INEFFSOL 


0.-130. 
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TABLE 7 



» * VARIMAX ROTATION 
INDIVIDUAL STUDENT DATA ♦** GRADE 11 **♦ ((1974)) 



ROTATION OF FIRST 8 FACTORS 
COMMUNALITIES 



GSELF ^ 


1 


0.77051 


RESPINTG 


17 


0.56883 


CONTENV 


2 


0.59872 


PHEALTH 


18 


0.44482 


RELATE 


3 


0.73861 


SAFETY 


19 


0.57317 


SCHLIMAG 


4 


0.66411 C4 


DRUGS 


, 20 * 


0.57841 


RACEG2, 


5 


0.59231 


' VISLART 


21 


0.74271 


REUG 


6 


0.50386 


PERFMART 


22 


0.74708 




7 


0 66496 


, SCIENCE 


23 


0 73529 


INTELL 


8 


0.60338 


. WRITING 


24 . 


' 0.71008 


HANDCP 


9 


0.62312 


WORKATD 


25 


p.70737 


GOAL - 3V 


10 


0.80054 


PLANING 


26 


0.78974 


GOAL - 3M 


11. 


0.75101 


G0AL-8K 


-27 


0.69434 . 


LEARN 


12 


0.50454 X 


VALUING 


28 


0.53595 ' 


SCHOOL 


13 


- 0.75968 J 


RECEIVING 


29 


0.52768 


TEACHER 


14 


0.75348 


EFFSOLN 


30 ' 


0.44054 


WELFDIG 


15 


. 0.63145 


INEFFSOL 


31 


0.68027 


LAWAUTH 

V 


16 


0.69320 


EMOTADJ 




0.86008 



TABLE 8 

SUM OF SQUARED ROTATED FACTOR LOADINGS 



FACTOR 1 
FACTOR 2 
FACTOR 3 
FACTOR 4 
FACTOR 5 
FACTOR 6 
FACTOR 7 
FACTOR 8 



SUM FOR 
EACH COLUMN 

4.2040 

3.0301 

2.8594 ^, 

3.3338 Z 

2.3106 • ■ 

2.3551^15 

1.3131 

1.5S37 



PERCENT 
OF TliACT* 

13.14 

9.47 

.8.94 
10.42 

.7.22 

7.36. 
*4.10 

4.95 ' 




•MS 



r' ■< 
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The Pennsylvania Education Quality Assessment Inventory's efficiency in generating an 
accurate profile of studentbody needs hinges on the ability of people to communicate with people 
through the medium of paper-and-pencil tests. Evidence supporting this notion has been obtained 
through a long series of studies conducted by Department of Education personnel with the help 
of administrators, teachers and students in over 40 per cent X)f Pennsylvania's local school districts. 
Findings support generalizations that: , * ^ . ' 

Students can read and Understand the questions in the battery ' 

V. Students tend to answer the questions in such a way^as to . . 

.^-^ reflect their true feelings 



Students answer similar items in a consistent manner 

Students tend to answer items in similar ways across-sjtime 

Student classroom behaviors are mirrored by student test scores 

Students generally feel the tests are worthwhile and the vast, 
majority take the tests seriously 

■r V, " 
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ORGANIZING INFPRMATION TO 1DENTIFY.STUDENT TARGET GROUPS;i 

Ideally, when preparing to initiate a program to facilitate student progress in any goal 
area, one should' be able to identify students most likely to benefit from that program^Hx^wever, 
in^nation available to schools participating in Pennsylvania's Educationaljiuality Assessment 
PfUfem does nat contain data on individual students. Consequently, iflslmpossible for school 
personnel to identify by name the members of the target group toward whom a program miglit 
be focused. . * • 

Even though individual profiles are unavailable, it is- possible t<y organize data in ways, 
that help identify general student groups that demonstrate needs in a given goal area^ This is 
-done by 'summarizing' data for various subgroups of students^ formed from selected' Student 
characteristics. The characteristics defining the subgroups are achieveihent level, sex and father*s 
occupational status. 

Student ability is categorized into three levels on the basis of the composite math-verbal 
achievement score. Students scoring -below the 30th percentile are defined as the low ability group* 
Students scoring between the 30th and^70th percentile are placed in the middle ability group. 
T^hose exceeding the 70th percentile are defined as' the hi^ ability group. 

: Students are also assigned to three groups on the basis of their father's or legal guardian's 

reported oa::upation. These occupation categories are labeled for convenience as semiskilled, skilled 
and professional. These categori^re abstractions based upon the average educational requirements 
necessary to obtain ^e job and the average amount of compensation for the particular occupations. 
^ It is recognized here that there are exceptions in any or all of these categories. The semiskilled 
occupational category includes hospital attendant laborer, operator of industrial equipment, packer, 
» wrapper, miner, quarry worker, painter, roofer, paper hanger, carpet layer, truck driver, taxi driver; 
senW^ station attendant, watchm'an, barber, waiter, cook, farmer and carpenter. 



^ The* skilled occupational category included cabinetmaker, dental technician, nurse, 

i librarian, foreman, toolmaker, machinist, electrician, plumber, bricklayer, stonemason, heavy 
( equipment operator, mail carrier, telephone operator, printer, decorator, policeman, firefighter, 
^ repairman, butcher, mechanic.. tailor, forester, secretary, clerk, office worker, salesperson, grocer 



and minister 

, The /professional occupational category^cludes 'dentist, doctor, veterinarian, architect, 
pilot, teacher, school administrator, editor, farm agent, stockbroker, insurance agent, real estate 
agent, personnel manager, bank official, lawyer, judge, engineer, social scientist and natural 
scientist. , / 

^ Eighteen groups are formed by taking all possible combinations of the three student 

} characteristics. The proportion of students w*ho responded favorably to more than one-half of 
1 the items comprising each scale are presented in 1[able 9. . , ' . 

i ■ • - ■ 
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TABLE91 

' PER CENT OF STUDENTS SHOWING K>SrnVE ATTITUDE: 
BYiiOALAI^A" 



I^PE OF STUDENTS 



Low ability ^ • , 


Semis^pUecT fathers 




Males 


Low ability • 


Semiskilled fathers 




Females * 


Low ability . 


^siciUed fathers* * 


« 


Males 


Low ability 


Skilled fathers 

< 




Females 


Low ability 


Professional fathers 




1 Male^ 


Low ability ^ 


Professional fathers 




Females 


> Middle ability 
K^d(lle ability 


Semiskilled fathers 
Semiskilled fathers 




* Males 
Females 

^ vinculo 

MS ' 


Miudie ability 


okiiied latners ^ 


t 


* Males ' 


Middle ability. 
* 


Skilled fathers 




Fein ales 


^ Middje ability * 


Professional fathers 




* 

Males 


Middle ability 


Professional fathers 




. Females 


High ability 


Semiskilled fathers 


» / 


" / Males 


High ability 


Semiskilled fathers 




' Females 


High ability 


Skilled fathers , ' - 




Males 


High ability . ^ j * 


Professional fathers 


V 


.Males 


High ability 


Professiot)al fathers 




Fenrtfes 


Average per cent showing ^positive attitude^ ^ 

4 







Qearly, in today's world, women are playing an increasingly important role in .defimng tlje 
occupational level of the family. However, data were unbailable to reflect this trend. Therefore, 
we are forced to use the father's occupational level as a proxy- for the socioeconomic conditions 
of the home. ^ 



TABLE9(con't.) 

PER CENT OF STUDENTS SHOWING POSITIVE ATTITUDE: 
BYGOALAREA 



GO'AL NUMBER 

! 


I 


n ^ 




V 


VI 


vn-A 


vn-p 


vin 


IX 




V, ' 




. 74 • 


66^ 


40 


5- 


• 

37 


40 * 


^. 16 


77 


• 

25 


69 


*■ 




77 


78 


49 


32 


51 


46 


10 


. 85 


36 . 


78 








73 


43 ^ 


8 


^38 


50 


, 24' 


.80 


26 . 


69 


r 


I 


76 


79. 


48 


23 


' 53 

• • 


.47 


9 


83' ^ 


36 


79 - 




•64 


(SB 


35 


c 9 


'24 


' 46 


. 19 


78 / 


19 


51 






82 


.80 


53 


28 


42 




' 15 


82 ' 


53 


75. - . 




/ 




JS7 


'54 


1-2 


44 


-43 


14 


, 87 ■ 


37 


79 ^ 


i 

' * I 

. I 






96 


64- 


34; 


r 

59 




8- 


91.*' 


54> 


80 




• 


- 84 


> 

65 


51 


12 . 


45 , 




13 


86 


' 37 


74 






.85 


-85, 


62 


36 


' 57. ' 


'50 . 


10 


94 


61 


83 






88 


83 


62 


27 


60 


'52. 


10 


J 

89 


50 


79* 


> 




89 


48 ' 


60 . 


39 


60 


65' 


• 16 


.97 


61 


.89 




S5 


70' 


61 


24 


54 


., 47 


.* 8 ' 


90 


53 


76' 


1 




86 


9Q: 


68* 


49. 


68 


65 


10 


- 95 


' 80 ' 


' 85 






* 89 


.76 


63 


21 


53 


47 . 


10 • 


86 


•61 


84 


I 




913 




71 


51 

* 


61 


64 


15 


98 


83 


89* 






93 


79 


68 


20 . 


49 


54 


11 • 


89 


61 


82 


y 




92 


92 


79 


51 


65. 


68 


16 


96 


82 


88 




•* 


. -84% 


79% 


58% 


.27% 


52% 


51%' 


• 13% 

« 


. 88%. 


51% 


79% 



/ - 



\ 



Note: Student percentages based on random saniple.^f 328^ 1 1th grade students. 
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